2025-04-02 02:52:29,129 [ 481021 ] INFO : ClickHouse root is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse (runner:53, check_args_and_update_paths) 2025-04-02 02:52:29,130 [ 481021 ] INFO : Cases dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:97, check_args_and_update_paths) 2025-04-02 02:52:29,130 [ 481021 ] INFO : utils dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/utils (runner:108, check_args_and_update_paths) 2025-04-02 02:52:29,130 [ 481021 ] INFO : base_configs_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/programs/server, binary: /home/ubuntu/_work/_temp/test/build/clickhouse, cases_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:110, check_args_and_update_paths) clickhouse_integration_tests_volume Running pytest container as: 'docker run --rm --name clickhouse_integration_tests_oaaanz --privileged --dns-search='.' --memory=30709035008 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=5dc43a6382f0 -e DOCKER_BASE_TAG=8b2301119731 -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=caad4729259e -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e CLICKHOUSE_USE_OLD_ANALYZER=1 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_postgresql_replica_database_engine_1/test.py::test_different_data_types test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries test_postgresql_replica_database_engine_1/test.py::test_multiple_databases test_postgresql_replica_database_engine_1/test.py::test_quoting_1 test_postgresql_replica_database_engine_1/test.py::test_quoting_2 test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index test_postgresql_replica_database_engine_1/test.py::test_replicating_dml test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_single_transaction test_postgresql_replica_database_engine_1/test.py::test_table_schema_changes test_postgresql_replica_database_engine_1/test.py::test_user_managed_slots test_postgresql_replica_database_engine_1/test.py::test_virtual_columns test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers test_reload_client_certificate/test.py::test_correct_cn_cert test_reload_client_certificate/test.py::test_wrong_cn_cert test_reload_clusters_config/test.py::test_add_cluster test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_simple_reload test_reload_clusters_config/test.py::test_update_one_cluster test_remote_prewhere/test.py::test_remote test_remove_stale_moving_parts/test.py::test_remove_stale_moving_parts_without_zookeeper test_rename_column/test.py::test_rename_distributed test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select test_rename_column/test.py::test_rename_parallel test_rename_column/test.py::test_rename_parallel_same_node test_rename_column/test.py::test_rename_with_parallel_insert test_rename_column/test.py::test_rename_with_parallel_merges test_rename_column/test.py::test_rename_with_parallel_select test_rename_column/test.py::test_rename_with_parallel_slow_insert test_rename_column/test.py::test_rename_with_parallel_ttl_delete test_rename_column/test.py::test_rename_with_parallel_ttl_move test_replicated_merge_tree_compatibility/test.py::test_replicated_merge_tree_defaults_compatibility test_replicated_merge_tree_encrypted_disk/test.py::test_different_keys test_replicated_merge_tree_encrypted_disk/test.py::test_same_keys test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl test_replicated_merge_tree_s3_zero_copy/test.py::test_drop_table 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[0-16]' 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[8192-12]' test_replicated_merge_tree_s3_zero_copy/test.py::test_s3_check_restore test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns test_replicated_user_defined_functions/test.py::test_create_and_drop 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[false-expected_raise1]' 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[true-expected_raise0]' test_replicated_user_defined_functions/test.py::test_create_and_replace test_replicated_user_defined_functions/test.py::test_drop_if_exists test_replicated_user_defined_functions/test.py::test_reload_zookeeper test_replicated_user_defined_functions/test.py::test_replication test_replicated_user_defined_functions/test.py::test_replication_replace_by_another_node_after_creation test_replicated_user_defined_functions/test.py::test_server_restart test_replicated_user_defined_functions/test.py::test_start_without_zookeeper test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart test_restore_external_engines/test.py::test_restore_table test_restore_external_engines/test.py::test_restore_table_null test_rocksdb_options/test.py::test_invalid_block_based_table_options test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options test_s3_imds/test_session_token.py::test_credentials_from_metadata test_s3_imds/test_simple.py::test_credentials_from_metadata test_s3_latency_log/test.py::test_latency_log test_s3_low_cardinality_right_border/test.py::test_s3_right_border test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 test_s3_storage_class/test.py::test_s3_storage_class_right 'test_s3_storage_conf_new_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver]' test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy_no_proxy test_scheduler/test.py::test_create_workload test_scheduler/test.py::test_merge_workload test_scheduler/test.py::test_merge_workload_change test_scheduler/test.py::test_merge_workload_override test_scheduler/test.py::test_mutate_workload test_scheduler/test.py::test_mutation_workload_change test_scheduler/test.py::test_mutation_workload_override test_scheduler/test.py::test_resource_any_disk test_scheduler/test.py::test_resource_read_and_write test_scheduler/test.py::test_s3_disk test_scheduler/test.py::test_s3_resource_request_granularity test_scheduler/test.py::test_throw_on_unknown_workload test_scheduler/test.py::test_workload_entity_keeper_storage test_scheduler/test.py::test_workload_hierarchy_changes test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_settings_constraints_distributed/test.py::test_select_clamps_settings -vvv -ss" altinityinfra/integration-tests-runner:2165613c5fcd '. Start tests ============================= test session starts ============================== platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.5.0 -- /usr/bin/python3 cachedir: .pytest_cache Test order randomisation NOT enabled. Enable with --random-order or --random-order-bucket= rootdir: /ClickHouse/tests/integration configfile: pytest.ini plugins: timeout-2.3.1, repeat-0.9.3, order-1.0.0, reportlog-0.4.0, xdist-3.5.0, random-order-1.1.1 timeout: 900.0s timeout method: signal timeout func_only: False created: 10/10 workers 10 workers [100 items] scheduling tests via LoadFileScheduling test_replicated_user_defined_functions/test.py::test_create_and_drop Command:[docker ps | wc -l] Command:[docker ps | wc -l] Command:[docker ps | wc -l] Command:[docker ps | wc -l] Command:[docker ps | wc -l] Command:[docker ps | wc -l] test_rocksdb_options/test.py::test_invalid_block_based_table_options Command:[docker ps | wc -l] Command:[docker ps | wc -l] Command:[docker ps | wc -l] Command:[docker ps | wc -l] Command:[docker ps | wc -l] Command:[docker ps | wc -l] Command:[docker ps | wc -l] Command:[docker ps | wc -l] Command:[docker ps | wc -l] Command:[docker ps | wc -l] Command:[docker ps | wc -l] Command:[docker ps | wc -l] test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_no_proxy test_reload_client_certificate/test.py::test_correct_cn_cert test_replicated_merge_tree_s3_zero_copy/test.py::test_drop_table test_rename_column/test.py::test_rename_distributed test_scheduler/test.py::test_create_workload test_reload_clusters_config/test.py::test_add_cluster test_s3_low_cardinality_right_border/test.py::test_s3_right_border test_postgresql_replica_database_engine_1/test.py::test_different_data_types Command:[docker ps | wc -l] Command:[docker ps | wc -l] Stdout:1 Stdout:1 No running containers No running containers Pruning Docker networks Pruning Docker networks Command:[docker network prune --force] Command:[docker network prune --force] Stdout:1 Stdout:1 No running containers No running containers Pruning Docker networks Pruning Docker networks Command:[docker network prune --force] Command:[docker network prune --force] Stdout:1 Stdout:1 No running containers No running containers Pruning Docker networks Pruning Docker networks Command:[docker network prune --force] Command:[docker network prune --force] Stdout:1 Stdout:1 No running containers No running containers Stdout:1 Pruning Docker networks Stdout:1 Pruning Docker networks Command:[docker network prune --force] Command:[docker network prune --force] No running containers No running containers Pruning Docker networks Pruning Docker networks Command:[docker network prune --force] Command:[docker network prune --force] Stdout:1 Stdout:1 No running containers No running containers Pruning Docker networks Pruning Docker networks Command:[docker network prune --force] Command:[docker network prune --force] Stdout:1 Stdout:1 No running containers No running containers Pruning Docker networks Pruning Docker networks Command:[docker network prune --force] Command:[docker network prune --force] Stdout:1 Stdout:1 No running containers No running containers Pruning Docker networks Pruning Docker networks Command:[docker network prune --force] Command:[docker network prune --force] Stdout:1 Stdout:1 No running containers No running containers Pruning Docker networks Pruning Docker networks Command:[docker network prune --force] Command:[docker network prune --force] Stdout:1 Stdout:1 No running containers No running containers Pruning Docker networks Pruning Docker networks Command:[docker network prune --force] Command:[docker network prune --force] Stderr:Error response from daemon: a prune operation is already running Stderr:Error response from daemon: a prune operation is already running Exitcode:1 Exitcode:1 Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] Stderr:Error response from daemon: a prune operation is already running Stderr:Error response from daemon: a prune operation is already running Exitcode:1 Exitcode:1 Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] Stderr:Error response from daemon: a prune operation is already running Stderr:Error response from daemon: a prune operation is already running Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] Exitcode:1 Exitcode:1 Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] Stderr:Error response from daemon: a prune operation is already running Stderr:Error response from daemon: a prune operation is already running Exitcode:1 Exitcode:1 Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] Stderr:Error response from daemon: a prune operation is already running Stderr:Error response from daemon: a prune operation is already running Stderr:Error response from daemon: a prune operation is already running Stderr:Error response from daemon: a prune operation is already running Exitcode:1 Exitcode:1 Exitcode:1 Exitcode:1 Stdout:net.ipv4.ip_local_port_range = 55000 65535 Stdout:net.ipv4.ip_local_port_range = 55000 65535 Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] Stdout:net.ipv4.ip_local_port_range = 55000 65535 Stdout:net.ipv4.ip_local_port_range = 55000 65535 Running tests in /ClickHouse/tests/integration/test_replicated_user_defined_functions/test.py Running tests in /ClickHouse/tests/integration/test_replicated_user_defined_functions/test.py Stderr:Error response from daemon: a prune operation is already running Stderr:Error response from daemon: a prune operation is already running Cluster start called. is_up=False ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse Cluster start called. is_up=False ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse Exitcode:1 Exitcode:1 ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 ENV HOSTNAME e7837a770c02 ENV HOSTNAME e7837a770c02 ENV SHLVL 0 ENV SHLVL 0 ENV HOME /root ENV HOME /root Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] ENV OLDPWD / ENV OLDPWD / Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] ENV DOCKER_HELPER_TAG 5dc43a6382f0 ENV DOCKER_HELPER_TAG 5dc43a6382f0 ENV PYTHONUNBUFFERED 1 ENV PYTHONUNBUFFERED 1 ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e ENV UBSAN_OPTIONS print_stacktrace=1 ENV UBSAN_OPTIONS print_stacktrace=1 Stdout:net.ipv4.ip_local_port_range = 55000 65535 Stdout:net.ipv4.ip_local_port_range = 55000 65535 ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_postgresql_replica_database_engine_1/test.py::test_different_data_types test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries test_postgresql_replica_database_engine_1/test.py::test_multiple_databases test_postgresql_replica_database_engine_1/test.py::test_quoting_1 test_postgresql_replica_database_engine_1/test.py::test_quoting_2 test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index test_postgresql_replica_database_engine_1/test.py::test_replicating_dml test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_single_transaction test_postgresql_replica_database_engine_1/test.py::test_table_schema_changes test_postgresql_replica_database_engine_1/test.py::test_user_managed_slots test_postgresql_replica_database_engine_1/test.py::test_virtual_columns test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers test_reload_client_certificate/test.py::test_correct_cn_cert test_reload_client_certificate/test.py::test_wrong_cn_cert test_reload_clusters_config/test.py::test_add_cluster test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_simple_reload test_reload_clusters_config/test.py::test_update_one_cluster test_remote_prewhere/test.py::test_remote test_remove_stale_moving_parts/test.py::test_remove_stale_moving_parts_without_zookeeper test_rename_column/test.py::test_rename_distributed test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select test_rename_column/test.py::test_rename_parallel test_rename_column/test.py::test_rename_parallel_same_node test_rename_column/test.py::test_rename_with_parallel_insert test_rename_column/test.py::test_rename_with_parallel_merges test_rename_column/test.py::test_rename_with_parallel_select test_rename_column/test.py::test_rename_with_parallel_slow_insert test_rename_column/test.py::test_rename_with_parallel_ttl_delete test_rename_column/test.py::test_rename_with_parallel_ttl_move test_replicated_merge_tree_compatibility/test.py::test_replicated_merge_tree_defaults_compatibility test_replicated_merge_tree_encrypted_disk/test.py::test_different_keys test_replicated_merge_tree_encrypted_disk/test.py::test_same_keys test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl test_replicated_merge_tree_s3_zero_copy/test.py::test_drop_table 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[0-16]' 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[8192-12]' test_replicated_merge_tree_s3_zero_copy/test.py::test_s3_check_restore test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns test_replicated_user_defined_functions/test.py::test_create_and_drop 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[false-expected_raise1]' 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[true-expected_raise0]' test_replicated_user_defined_functions/test.py::test_create_and_replace test_replicated_user_defined_functions/test.py::test_drop_if_exists test_replicated_user_defined_functions/test.py::test_reload_zookeeper test_replicated_user_defined_functions/test.py::test_replication test_replicated_user_defined_functions/test.py::test_replication_replace_by_another_node_after_creation test_replicated_user_defined_functions/test.py::test_server_restart test_replicated_user_defined_functions/test.py::test_start_without_zookeeper test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart test_restore_external_engines/test.py::test_restore_table test_restore_external_engines/test.py::test_restore_table_null test_rocksdb_options/test.py::test_invalid_block_based_table_options test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options test_s3_imds/test_session_token.py::test_credentials_from_metadata test_s3_imds/test_simple.py::test_credentials_from_metadata test_s3_latency_log/test.py::test_latency_log test_s3_low_cardinality_right_border/test.py::test_s3_right_border test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 test_s3_storage_class/test.py::test_s3_storage_class_right 'test_s3_storage_conf_new_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver]' test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy_no_proxy test_scheduler/test.py::test_create_workload test_scheduler/test.py::test_merge_workload test_scheduler/test.py::test_merge_workload_change test_scheduler/test.py::test_merge_workload_override test_scheduler/test.py::test_mutate_workload test_scheduler/test.py::test_mutation_workload_change test_scheduler/test.py::test_mutation_workload_override test_scheduler/test.py::test_resource_any_disk test_scheduler/test.py::test_resource_read_and_write test_scheduler/test.py::test_s3_disk test_scheduler/test.py::test_s3_resource_request_granularity test_scheduler/test.py::test_throw_on_unknown_workload test_scheduler/test.py::test_workload_entity_keeper_storage test_scheduler/test.py::test_workload_hierarchy_changes test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_settings_constraints_distributed/test.py::test_select_clamps_settings -vvv -ss ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_postgresql_replica_database_engine_1/test.py::test_different_data_types test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries test_postgresql_replica_database_engine_1/test.py::test_multiple_databases test_postgresql_replica_database_engine_1/test.py::test_quoting_1 test_postgresql_replica_database_engine_1/test.py::test_quoting_2 test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index test_postgresql_replica_database_engine_1/test.py::test_replicating_dml test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_single_transaction test_postgresql_replica_database_engine_1/test.py::test_table_schema_changes test_postgresql_replica_database_engine_1/test.py::test_user_managed_slots test_postgresql_replica_database_engine_1/test.py::test_virtual_columns test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers test_reload_client_certificate/test.py::test_correct_cn_cert test_reload_client_certificate/test.py::test_wrong_cn_cert test_reload_clusters_config/test.py::test_add_cluster test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_simple_reload test_reload_clusters_config/test.py::test_update_one_cluster test_remote_prewhere/test.py::test_remote test_remove_stale_moving_parts/test.py::test_remove_stale_moving_parts_without_zookeeper test_rename_column/test.py::test_rename_distributed test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select test_rename_column/test.py::test_rename_parallel test_rename_column/test.py::test_rename_parallel_same_node test_rename_column/test.py::test_rename_with_parallel_insert test_rename_column/test.py::test_rename_with_parallel_merges test_rename_column/test.py::test_rename_with_parallel_select test_rename_column/test.py::test_rename_with_parallel_slow_insert test_rename_column/test.py::test_rename_with_parallel_ttl_delete test_rename_column/test.py::test_rename_with_parallel_ttl_move test_replicated_merge_tree_compatibility/test.py::test_replicated_merge_tree_defaults_compatibility test_replicated_merge_tree_encrypted_disk/test.py::test_different_keys test_replicated_merge_tree_encrypted_disk/test.py::test_same_keys test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl test_replicated_merge_tree_s3_zero_copy/test.py::test_drop_table 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[0-16]' 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[8192-12]' test_replicated_merge_tree_s3_zero_copy/test.py::test_s3_check_restore test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns test_replicated_user_defined_functions/test.py::test_create_and_drop 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[false-expected_raise1]' 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[true-expected_raise0]' test_replicated_user_defined_functions/test.py::test_create_and_replace test_replicated_user_defined_functions/test.py::test_drop_if_exists test_replicated_user_defined_functions/test.py::test_reload_zookeeper test_replicated_user_defined_functions/test.py::test_replication test_replicated_user_defined_functions/test.py::test_replication_replace_by_another_node_after_creation test_replicated_user_defined_functions/test.py::test_server_restart test_replicated_user_defined_functions/test.py::test_start_without_zookeeper test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart test_restore_external_engines/test.py::test_restore_table test_restore_external_engines/test.py::test_restore_table_null test_rocksdb_options/test.py::test_invalid_block_based_table_options test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options test_s3_imds/test_session_token.py::test_credentials_from_metadata test_s3_imds/test_simple.py::test_credentials_from_metadata test_s3_latency_log/test.py::test_latency_log test_s3_low_cardinality_right_border/test.py::test_s3_right_border test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 test_s3_storage_class/test.py::test_s3_storage_class_right 'test_s3_storage_conf_new_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver]' test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy_no_proxy test_scheduler/test.py::test_create_workload test_scheduler/test.py::test_merge_workload test_scheduler/test.py::test_merge_workload_change test_scheduler/test.py::test_merge_workload_override test_scheduler/test.py::test_mutate_workload test_scheduler/test.py::test_mutation_workload_change test_scheduler/test.py::test_mutation_workload_override test_scheduler/test.py::test_resource_any_disk test_scheduler/test.py::test_resource_read_and_write test_scheduler/test.py::test_s3_disk test_scheduler/test.py::test_s3_resource_request_granularity test_scheduler/test.py::test_throw_on_unknown_workload test_scheduler/test.py::test_workload_entity_keeper_storage test_scheduler/test.py::test_workload_hierarchy_changes test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_settings_constraints_distributed/test.py::test_select_clamps_settings -vvv -ss ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge Stdout:net.ipv4.ip_local_port_range = 55000 65535 ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge Stdout:net.ipv4.ip_local_port_range = 55000 65535 ENV COMPOSE_HTTP_TIMEOUT 600 ENV COMPOSE_HTTP_TIMEOUT 600 ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 ENV CLICKHOUSE_USE_OLD_ANALYZER 1 Running tests in /ClickHouse/tests/integration/test_rocksdb_options/test.py ENV CLICKHOUSE_USE_OLD_ANALYZER 1 Running tests in /ClickHouse/tests/integration/test_rocksdb_options/test.py ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin Stdout:net.ipv4.ip_local_port_range = 55000 65535 Stdout:net.ipv4.ip_local_port_range = 55000 65535 ENV DOCKER_KERBERIZED_HADOOP_TAG latest ENV DOCKER_KERBERIZED_HADOOP_TAG latest ENV DOCKER_CHANNEL stable ENV DOCKER_CHANNEL stable Running tests in /ClickHouse/tests/integration/test_rename_column/test.py Running tests in /ClickHouse/tests/integration/test_rename_column/test.py Cluster start called. is_up=False Cluster start called. is_up=False ENV DOCKER_CLIENT_TIMEOUT 300 ENV DOCKER_CLIENT_TIMEOUT 300 ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e Cluster start called. is_up=False ENV PWD /ClickHouse/tests/integration ENV PWD /ClickHouse/tests/integration Cluster start called. is_up=False ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse ENV TZ Etc/UTC ENV TZ Etc/UTC ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 ENV DOCKER_BASE_TAG 8b2301119731 ENV DOCKER_BASE_TAG 8b2301119731 ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 ENV LC_CTYPE C.UTF-8 ENV LC_CTYPE C.UTF-8 ENV HOSTNAME e7837a770c02 ENV HOSTNAME e7837a770c02 ENV INTEGRATION_TESTS_RUN_ID 0 ENV INTEGRATION_TESTS_RUN_ID 0 ENV WORKER_FREE_PORTS 30300 30301 30302 30303 30304 30305 30306 30307 30308 30309 30310 30311 30312 30313 30314 30315 30316 30317 30318 30319 30320 30321 30322 30323 30324 30325 30326 30327 30328 30329 30330 30331 30332 30333 30334 30335 30336 30337 30338 30339 30340 30341 30342 30343 30344 30345 30346 30347 30348 30349 ENV SHLVL 0 ENV WORKER_FREE_PORTS 30300 30301 30302 30303 30304 30305 30306 30307 30308 30309 30310 30311 30312 30313 30314 30315 30316 30317 30318 30319 30320 30321 30322 30323 30324 30325 30326 30327 30328 30329 30330 30331 30332 30333 30334 30335 30336 30337 30338 30339 30340 30341 30342 30343 30344 30345 30346 30347 30348 30349 ENV SHLVL 0 ENV PYTEST_XDIST_TESTRUNUID abec1c7124634c26ad4fb6ef8710757d ENV HOME /root ENV PYTEST_XDIST_TESTRUNUID abec1c7124634c26ad4fb6ef8710757d ENV HOME /root ENV PYTEST_XDIST_WORKER gw6 ENV PYTEST_XDIST_WORKER gw6 ENV OLDPWD / ENV OLDPWD / ENV PYTEST_XDIST_WORKER_COUNT 10 ENV PYTEST_XDIST_WORKER_COUNT 10 ENV DOCKER_HELPER_TAG 5dc43a6382f0 ENV DOCKER_HELPER_TAG 5dc43a6382f0 ENV PYTEST_CURRENT_TEST test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_no_proxy (setup) ENV PYTEST_CURRENT_TEST test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_no_proxy (setup) ENV PYTHONUNBUFFERED 1 ENV PYTHONUNBUFFERED 1 ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e ENV UBSAN_OPTIONS print_stacktrace=1 ENV UBSAN_OPTIONS print_stacktrace=1 ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_postgresql_replica_database_engine_1/test.py::test_different_data_types test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries test_postgresql_replica_database_engine_1/test.py::test_multiple_databases test_postgresql_replica_database_engine_1/test.py::test_quoting_1 test_postgresql_replica_database_engine_1/test.py::test_quoting_2 test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index test_postgresql_replica_database_engine_1/test.py::test_replicating_dml test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_single_transaction test_postgresql_replica_database_engine_1/test.py::test_table_schema_changes test_postgresql_replica_database_engine_1/test.py::test_user_managed_slots test_postgresql_replica_database_engine_1/test.py::test_virtual_columns test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers test_reload_client_certificate/test.py::test_correct_cn_cert test_reload_client_certificate/test.py::test_wrong_cn_cert test_reload_clusters_config/test.py::test_add_cluster test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_simple_reload test_reload_clusters_config/test.py::test_update_one_cluster test_remote_prewhere/test.py::test_remote test_remove_stale_moving_parts/test.py::test_remove_stale_moving_parts_without_zookeeper test_rename_column/test.py::test_rename_distributed test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select test_rename_column/test.py::test_rename_parallel test_rename_column/test.py::test_rename_parallel_same_node test_rename_column/test.py::test_rename_with_parallel_insert test_rename_column/test.py::test_rename_with_parallel_merges test_rename_column/test.py::test_rename_with_parallel_select test_rename_column/test.py::test_rename_with_parallel_slow_insert test_rename_column/test.py::test_rename_with_parallel_ttl_delete test_rename_column/test.py::test_rename_with_parallel_ttl_move test_replicated_merge_tree_compatibility/test.py::test_replicated_merge_tree_defaults_compatibility test_replicated_merge_tree_encrypted_disk/test.py::test_different_keys test_replicated_merge_tree_encrypted_disk/test.py::test_same_keys test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl test_replicated_merge_tree_s3_zero_copy/test.py::test_drop_table 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[0-16]' 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[8192-12]' test_replicated_merge_tree_s3_zero_copy/test.py::test_s3_check_restore test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns test_replicated_user_defined_functions/test.py::test_create_and_drop 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[false-expected_raise1]' 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[true-expected_raise0]' test_replicated_user_defined_functions/test.py::test_create_and_replace test_replicated_user_defined_functions/test.py::test_drop_if_exists test_replicated_user_defined_functions/test.py::test_reload_zookeeper test_replicated_user_defined_functions/test.py::test_replication test_replicated_user_defined_functions/test.py::test_replication_replace_by_another_node_after_creation test_replicated_user_defined_functions/test.py::test_server_restart test_replicated_user_defined_functions/test.py::test_start_without_zookeeper test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart test_restore_external_engines/test.py::test_restore_table test_restore_external_engines/test.py::test_restore_table_null test_rocksdb_options/test.py::test_invalid_block_based_table_options test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options test_s3_imds/test_session_token.py::test_credentials_from_metadata test_s3_imds/test_simple.py::test_credentials_from_metadata test_s3_latency_log/test.py::test_latency_log test_s3_low_cardinality_right_border/test.py::test_s3_right_border test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 test_s3_storage_class/test.py::test_s3_storage_class_right 'test_s3_storage_conf_new_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver]' test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy_no_proxy test_scheduler/test.py::test_create_workload test_scheduler/test.py::test_merge_workload test_scheduler/test.py::test_merge_workload_change test_scheduler/test.py::test_merge_workload_override test_scheduler/test.py::test_mutate_workload test_scheduler/test.py::test_mutation_workload_change test_scheduler/test.py::test_mutation_workload_override test_scheduler/test.py::test_resource_any_disk test_scheduler/test.py::test_resource_read_and_write test_scheduler/test.py::test_s3_disk test_scheduler/test.py::test_s3_resource_request_granularity test_scheduler/test.py::test_throw_on_unknown_workload test_scheduler/test.py::test_workload_entity_keeper_storage test_scheduler/test.py::test_workload_hierarchy_changes test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_settings_constraints_distributed/test.py::test_select_clamps_settings -vvv -ss ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_postgresql_replica_database_engine_1/test.py::test_different_data_types test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries test_postgresql_replica_database_engine_1/test.py::test_multiple_databases test_postgresql_replica_database_engine_1/test.py::test_quoting_1 test_postgresql_replica_database_engine_1/test.py::test_quoting_2 test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index test_postgresql_replica_database_engine_1/test.py::test_replicating_dml test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_single_transaction test_postgresql_replica_database_engine_1/test.py::test_table_schema_changes test_postgresql_replica_database_engine_1/test.py::test_user_managed_slots test_postgresql_replica_database_engine_1/test.py::test_virtual_columns test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers test_reload_client_certificate/test.py::test_correct_cn_cert test_reload_client_certificate/test.py::test_wrong_cn_cert test_reload_clusters_config/test.py::test_add_cluster test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_simple_reload test_reload_clusters_config/test.py::test_update_one_cluster test_remote_prewhere/test.py::test_remote test_remove_stale_moving_parts/test.py::test_remove_stale_moving_parts_without_zookeeper test_rename_column/test.py::test_rename_distributed test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select test_rename_column/test.py::test_rename_parallel test_rename_column/test.py::test_rename_parallel_same_node test_rename_column/test.py::test_rename_with_parallel_insert test_rename_column/test.py::test_rename_with_parallel_merges test_rename_column/test.py::test_rename_with_parallel_select test_rename_column/test.py::test_rename_with_parallel_slow_insert test_rename_column/test.py::test_rename_with_parallel_ttl_delete test_rename_column/test.py::test_rename_with_parallel_ttl_move test_replicated_merge_tree_compatibility/test.py::test_replicated_merge_tree_defaults_compatibility test_replicated_merge_tree_encrypted_disk/test.py::test_different_keys test_replicated_merge_tree_encrypted_disk/test.py::test_same_keys test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl test_replicated_merge_tree_s3_zero_copy/test.py::test_drop_table 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[0-16]' 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[8192-12]' test_replicated_merge_tree_s3_zero_copy/test.py::test_s3_check_restore test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns test_replicated_user_defined_functions/test.py::test_create_and_drop 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[false-expected_raise1]' 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[true-expected_raise0]' test_replicated_user_defined_functions/test.py::test_create_and_replace test_replicated_user_defined_functions/test.py::test_drop_if_exists test_replicated_user_defined_functions/test.py::test_reload_zookeeper test_replicated_user_defined_functions/test.py::test_replication test_replicated_user_defined_functions/test.py::test_replication_replace_by_another_node_after_creation test_replicated_user_defined_functions/test.py::test_server_restart test_replicated_user_defined_functions/test.py::test_start_without_zookeeper test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart test_restore_external_engines/test.py::test_restore_table test_restore_external_engines/test.py::test_restore_table_null test_rocksdb_options/test.py::test_invalid_block_based_table_options test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options test_s3_imds/test_session_token.py::test_credentials_from_metadata test_s3_imds/test_simple.py::test_credentials_from_metadata test_s3_latency_log/test.py::test_latency_log test_s3_low_cardinality_right_border/test.py::test_s3_right_border test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 test_s3_storage_class/test.py::test_s3_storage_class_right 'test_s3_storage_conf_new_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver]' test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy_no_proxy test_scheduler/test.py::test_create_workload test_scheduler/test.py::test_merge_workload test_scheduler/test.py::test_merge_workload_change test_scheduler/test.py::test_merge_workload_override test_scheduler/test.py::test_mutate_workload test_scheduler/test.py::test_mutation_workload_change test_scheduler/test.py::test_mutation_workload_override test_scheduler/test.py::test_resource_any_disk test_scheduler/test.py::test_resource_read_and_write test_scheduler/test.py::test_s3_disk test_scheduler/test.py::test_s3_resource_request_granularity test_scheduler/test.py::test_throw_on_unknown_workload test_scheduler/test.py::test_workload_entity_keeper_storage test_scheduler/test.py::test_workload_hierarchy_changes test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_settings_constraints_distributed/test.py::test_select_clamps_settings -vvv -ss Stderr:Error response from daemon: a prune operation is already running ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge Stdout:net.ipv4.ip_local_port_range = 55000 65535 ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge Stderr:Error response from daemon: a prune operation is already running Stdout:net.ipv4.ip_local_port_range = 55000 65535 Stderr:Error response from daemon: a prune operation is already running Stderr:Error response from daemon: a prune operation is already running CLUSTER INIT base_config_dir:/clickhouse-config CLUSTER INIT base_config_dir:/clickhouse-config ENV COMPOSE_HTTP_TIMEOUT 600 ENV COMPOSE_HTTP_TIMEOUT 600 ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d Exitcode:1 ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse Exitcode:1 Cluster name: project_name:roottests3tablefunctionwithhttpproxy-gw6. Added instance name:remote_proxy_node tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/.env', '--project-name', 'roottests3tablefunctionwithhttpproxy-gw6', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 Cluster name: project_name:roottests3tablefunctionwithhttpproxy-gw6. Added instance name:remote_proxy_node tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/.env', '--project-name', 'roottests3tablefunctionwithhttpproxy-gw6', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 ENV CLICKHOUSE_USE_OLD_ANALYZER 1 ENV CLICKHOUSE_USE_OLD_ANALYZER 1 clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log Exitcode:1 Exitcode:1 ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin Cluster name: project_name:roottests3tablefunctionwithhttpproxy-gw6. Added instance name:remote_proxy_node_no_proxy tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/.env', '--project-name', 'roottests3tablefunctionwithhttpproxy-gw6', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node_no_proxy/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ ENV DOCKER_KERBERIZED_HADOOP_TAG latest Cluster name: project_name:roottests3tablefunctionwithhttpproxy-gw6. Added instance name:remote_proxy_node_no_proxy tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/.env', '--project-name', 'roottests3tablefunctionwithhttpproxy-gw6', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node_no_proxy/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ ENV DOCKER_KERBERIZED_HADOOP_TAG latest ENV DOCKER_CHANNEL stable clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log ENV DOCKER_CHANNEL stable Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] ENV DOCKER_CLIENT_TIMEOUT 300 ENV DOCKER_CLIENT_TIMEOUT 300 Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] Cluster name: project_name:roottests3tablefunctionwithhttpproxy-gw6. Added instance name:proxy_list_node tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/.env', '--project-name', 'roottests3tablefunctionwithhttpproxy-gw6', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Cluster name: project_name:roottests3tablefunctionwithhttpproxy-gw6. Added instance name:proxy_list_node tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/.env', '--project-name', 'roottests3tablefunctionwithhttpproxy-gw6', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 Running tests in /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/test.py Running tests in /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/test.py ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e Cluster name: project_name:roottests3tablefunctionwithhttpproxy-gw6. Added instance name:proxy_list_node_no_proxy tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/.env', '--project-name', 'roottests3tablefunctionwithhttpproxy-gw6', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node_no_proxy/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Cluster name: project_name:roottests3tablefunctionwithhttpproxy-gw6. Added instance name:proxy_list_node_no_proxy tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/.env', '--project-name', 'roottests3tablefunctionwithhttpproxy-gw6', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node_no_proxy/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ ENV PWD /ClickHouse/tests/integration ENV PWD /ClickHouse/tests/integration clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 Cluster name: project_name:roottests3tablefunctionwithhttpproxy-gw6. Added instance name:env_node tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/.env', '--project-name', 'roottests3tablefunctionwithhttpproxy-gw6', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Cluster name: project_name:roottests3tablefunctionwithhttpproxy-gw6. Added instance name:env_node tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/.env', '--project-name', 'roottests3tablefunctionwithhttpproxy-gw6', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge Cluster start called. is_up=False clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log Cluster start called. is_up=False ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] ENV TZ Etc/UTC Cluster name: project_name:roottests3tablefunctionwithhttpproxy-gw6. Added instance name:env_node_no_proxy tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/.env', '--project-name', 'roottests3tablefunctionwithhttpproxy-gw6', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node_no_proxy/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ ENV TZ Etc/UTC Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] Cluster name: project_name:roottests3tablefunctionwithhttpproxy-gw6. Added instance name:env_node_no_proxy tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/.env', '--project-name', 'roottests3tablefunctionwithhttpproxy-gw6', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node_no_proxy/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java Starting cluster... ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java Starting cluster... ENV DOCKER_BASE_TAG 8b2301119731 ENV DOCKER_BASE_TAG 8b2301119731 ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 Running tests in /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/test.py ENV LC_CTYPE C.UTF-8 Running tests in /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/test.py ENV LC_CTYPE C.UTF-8 ENV INTEGRATION_TESTS_RUN_ID 0 ENV INTEGRATION_TESTS_RUN_ID 0 ENV WORKER_FREE_PORTS 30250 30251 30252 30253 30254 30255 30256 30257 30258 30259 30260 30261 30262 30263 30264 30265 30266 30267 30268 30269 30270 30271 30272 30273 30274 30275 30276 30277 30278 30279 30280 30281 30282 30283 30284 30285 30286 30287 30288 30289 30290 30291 30292 30293 30294 30295 30296 30297 30298 30299 Cluster start called. is_up=False ENV WORKER_FREE_PORTS 30250 30251 30252 30253 30254 30255 30256 30257 30258 30259 30260 30261 30262 30263 30264 30265 30266 30267 30268 30269 30270 30271 30272 30273 30274 30275 30276 30277 30278 30279 30280 30281 30282 30283 30284 30285 30286 30287 30288 30289 30290 30291 30292 30293 30294 30295 30296 30297 30298 30299 Cluster start called. is_up=False ENV PYTEST_XDIST_TESTRUNUID abec1c7124634c26ad4fb6ef8710757d ENV PYTEST_XDIST_TESTRUNUID abec1c7124634c26ad4fb6ef8710757d ENV PYTEST_XDIST_WORKER gw5 ENV PYTEST_XDIST_WORKER gw5 ENV PYTEST_XDIST_WORKER_COUNT 10 ENV PYTEST_XDIST_WORKER_COUNT 10 ENV PYTEST_CURRENT_TEST test_replicated_merge_tree_s3_zero_copy/test.py::test_drop_table (setup) ENV PYTEST_CURRENT_TEST test_replicated_merge_tree_s3_zero_copy/test.py::test_drop_table (setup) CLUSTER INIT base_config_dir:/clickhouse-config CLUSTER INIT base_config_dir:/clickhouse-config clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log Stdout:net.ipv4.ip_local_port_range = 55000 65535 Stdout:net.ipv4.ip_local_port_range = 55000 65535 clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log Setup Keeper Setup Keeper Running tests in /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/test.py Cluster name: project_name:roottestreplicatedmergetrees3zerocopy-gw5. Added instance name:node1 tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/.env', '--project-name', 'roottestreplicatedmergetrees3zerocopy-gw5', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Running tests in /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/test.py Cluster name: project_name:roottestreplicatedmergetrees3zerocopy-gw5. Added instance name:node1 tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/.env', '--project-name', 'roottestreplicatedmergetrees3zerocopy-gw5', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log Cluster start called. is_up=False Cluster start called. is_up=False Cluster name: project_name:roottestreplicatedmergetrees3zerocopy-gw5. Added instance name:node2 tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/.env', '--project-name', 'roottestreplicatedmergetrees3zerocopy-gw5', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node2/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Cluster name: project_name:roottestreplicatedmergetrees3zerocopy-gw5. Added instance name:node2 tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/.env', '--project-name', 'roottestreplicatedmergetrees3zerocopy-gw5', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node2/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log Cluster name: project_name:roottestreplicatedmergetrees3zerocopy-gw5. Added instance name:node3 tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/.env', '--project-name', 'roottestreplicatedmergetrees3zerocopy-gw5', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node3/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Cluster name: project_name:roottestreplicatedmergetrees3zerocopy-gw5. Added instance name:node3 tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/.env', '--project-name', 'roottestreplicatedmergetrees3zerocopy-gw5', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node3/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Starting cluster... Starting cluster... Running tests in /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/test.py Stdout:net.ipv4.ip_local_port_range = 55000 65535 Stdout:net.ipv4.ip_local_port_range = 55000 65535 Running tests in /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/test.py Cluster start called. is_up=False Cluster start called. is_up=False Running tests in /ClickHouse/tests/integration/test_scheduler/test.py Running tests in /ClickHouse/tests/integration/test_scheduler/test.py Cluster start called. is_up=False Cluster start called. is_up=False Docker networks for project roottests3lowcardinalityrightborder-gw9 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3lowcardinalityrightborder-gw9 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestrocksdboptions-gw4 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestrocksdboptions-gw4 are NETWORK ID NAME DRIVER SCOPE Stdout:net.ipv4.ip_local_port_range = 55000 65535 Stdout:net.ipv4.ip_local_port_range = 55000 65535 Docker networks for project roottestrenamecolumn-gw0 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestrenamecolumn-gw0 are NETWORK ID NAME DRIVER SCOPE Running tests in /ClickHouse/tests/integration/test_reload_client_certificate/test.py Running tests in /ClickHouse/tests/integration/test_reload_client_certificate/test.py Cluster start called. is_up=False Cluster start called. is_up=False Docker networks for project roottestreplicateduserdefinedfunctions-gw2 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicateduserdefinedfunctions-gw2 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3tablefunctionwithhttpproxy-gw6 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3tablefunctionwithhttpproxy-gw6 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicatedmergetrees3zerocopy-gw5 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicatedmergetrees3zerocopy-gw5 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestscheduler-gw3 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestscheduler-gw3 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestpostgresqlreplicadatabaseengine1-gw1 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestpostgresqlreplicadatabaseengine1-gw1 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestrocksdboptions-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicateduserdefinedfunctions-gw2 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicateduserdefinedfunctions-gw2 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestrocksdboptions-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker networks for project roottestreloadclientcertificate-gw8 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreloadclientcertificate-gw8 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestrenamecolumn-gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestrenamecolumn-gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3tablefunctionwithhttpproxy-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3tablefunctionwithhttpproxy-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicatedmergetrees3zerocopy-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicatedmergetrees3zerocopy-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3lowcardinalityrightborder-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3lowcardinalityrightborder-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestscheduler-gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestscheduler-gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestpostgresqlreplicadatabaseengine1-gw1 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestpostgresqlreplicadatabaseengine1-gw1 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestrocksdboptions-gw4 are DRIVER VOLUME NAME Docker volumes for project roottestrocksdboptions-gw4 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker volumes for project roottestrenamecolumn-gw0 are DRIVER VOLUME NAME Docker volumes for project roottestrenamecolumn-gw0 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker containers for project roottestreloadclientcertificate-gw8 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreloadclientcertificate-gw8 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreplicateduserdefinedfunctions-gw2 are DRIVER VOLUME NAME Docker volumes for project roottestreplicateduserdefinedfunctions-gw2 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker volumes for project roottests3tablefunctionwithhttpproxy-gw6 are DRIVER VOLUME NAME Docker volumes for project roottests3tablefunctionwithhttpproxy-gw6 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker volumes for project roottestreplicatedmergetrees3zerocopy-gw5 are DRIVER VOLUME NAME Docker volumes for project roottestreplicatedmergetrees3zerocopy-gw5 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker volumes for project roottests3lowcardinalityrightborder-gw9 are DRIVER VOLUME NAME Docker volumes for project roottests3lowcardinalityrightborder-gw9 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker volumes for project roottestscheduler-gw3 are DRIVER VOLUME NAME Docker volumes for project roottestscheduler-gw3 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker networks for project roottestrocksdboptions-gw4 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestrocksdboptions-gw4 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestrenamecolumn-gw0 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestrenamecolumn-gw0 are NETWORK ID NAME DRIVER SCOPE Docker volumes for project roottestpostgresqlreplicadatabaseengine1-gw1 are DRIVER VOLUME NAME Docker volumes for project roottestpostgresqlreplicadatabaseengine1-gw1 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker networks for project roottestreplicateduserdefinedfunctions-gw2 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicateduserdefinedfunctions-gw2 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3tablefunctionwithhttpproxy-gw6 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3tablefunctionwithhttpproxy-gw6 are NETWORK ID NAME DRIVER SCOPE Docker volumes for project roottestreloadclientcertificate-gw8 are DRIVER VOLUME NAME Docker volumes for project roottestreloadclientcertificate-gw8 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker networks for project roottestreplicatedmergetrees3zerocopy-gw5 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicatedmergetrees3zerocopy-gw5 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3lowcardinalityrightborder-gw9 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3lowcardinalityrightborder-gw9 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestscheduler-gw3 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestscheduler-gw3 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestrocksdboptions-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestrocksdboptions-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestrenamecolumn-gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestrenamecolumn-gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker networks for project roottestpostgresqlreplicadatabaseengine1-gw1 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestpostgresqlreplicadatabaseengine1-gw1 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestreplicatedmergetrees3zerocopy-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicateduserdefinedfunctions-gw2 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicateduserdefinedfunctions-gw2 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3tablefunctionwithhttpproxy-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3tablefunctionwithhttpproxy-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicatedmergetrees3zerocopy-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker networks for project roottestreloadclientcertificate-gw8 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreloadclientcertificate-gw8 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3lowcardinalityrightborder-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3lowcardinalityrightborder-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestscheduler-gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestscheduler-gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestrenamecolumn-gw0 are DRIVER VOLUME NAME Docker volumes for project roottestrenamecolumn-gw0 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestrenamecolumn-gw0-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestrenamecolumn-gw0-.*-1$' --format '{{.ID}}:{{.Names}}'] Docker volumes for project roottestrocksdboptions-gw4 are DRIVER VOLUME NAME Docker volumes for project roottestrocksdboptions-gw4 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestrocksdboptions-gw4-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestrocksdboptions-gw4-.*-1$' --format '{{.ID}}:{{.Names}}'] Docker containers for project roottestpostgresqlreplicadatabaseengine1-gw1 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestpostgresqlreplicadatabaseengine1-gw1 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreplicateduserdefinedfunctions-gw2 are DRIVER VOLUME NAME Docker volumes for project roottestreplicateduserdefinedfunctions-gw2 are DRIVER VOLUME NAME Docker containers for project roottestreloadclientcertificate-gw8 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Command:[docker container list --all --filter name='^/roottestreplicateduserdefinedfunctions-gw2-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestreplicateduserdefinedfunctions-gw2-.*-1$' --format '{{.ID}}:{{.Names}}'] Docker containers for project roottestreloadclientcertificate-gw8 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3lowcardinalityrightborder-gw9 are DRIVER VOLUME NAME Docker volumes for project roottests3lowcardinalityrightborder-gw9 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottests3lowcardinalityrightborder-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottests3lowcardinalityrightborder-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] Docker volumes for project roottestreplicatedmergetrees3zerocopy-gw5 are DRIVER VOLUME NAME Docker volumes for project roottestreplicatedmergetrees3zerocopy-gw5 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestreplicatedmergetrees3zerocopy-gw5-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestreplicatedmergetrees3zerocopy-gw5-.*-1$' --format '{{.ID}}:{{.Names}}'] Docker volumes for project roottests3tablefunctionwithhttpproxy-gw6 are DRIVER VOLUME NAME Docker volumes for project roottests3tablefunctionwithhttpproxy-gw6 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottests3tablefunctionwithhttpproxy-gw6-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottests3tablefunctionwithhttpproxy-gw6-.*-1$' --format '{{.ID}}:{{.Names}}'] Docker volumes for project roottestscheduler-gw3 are DRIVER VOLUME NAME Docker volumes for project roottestscheduler-gw3 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestscheduler-gw3-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestscheduler-gw3-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestrenamecolumn-gw0 No running containers for project: roottestrenamecolumn-gw0 Trying to prune unused networks... Trying to prune unused networks... Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestrocksdboptions-gw4 No running containers for project: roottestrocksdboptions-gw4 Trying to prune unused networks... Trying to prune unused networks... Unstopped containers: {} Unstopped containers: {} Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestreplicateduserdefinedfunctions-gw2 No running containers for project: roottestreplicateduserdefinedfunctions-gw2 Trying to prune unused networks... Trying to prune unused networks... No running containers for project: roottests3lowcardinalityrightborder-gw9 No running containers for project: roottests3lowcardinalityrightborder-gw9 Trying to prune unused networks... Trying to prune unused networks... Unstopped containers: {} Unstopped containers: {} Docker volumes for project roottestreloadclientcertificate-gw8 are DRIVER VOLUME NAME Docker volumes for project roottestreloadclientcertificate-gw8 are DRIVER VOLUME NAME No running containers for project: roottestreplicatedmergetrees3zerocopy-gw5 Docker volumes for project roottestpostgresqlreplicadatabaseengine1-gw1 are DRIVER VOLUME NAME No running containers for project: roottestreplicatedmergetrees3zerocopy-gw5 Docker volumes for project roottestpostgresqlreplicadatabaseengine1-gw1 are DRIVER VOLUME NAME Trying to prune unused networks... Command:[docker container list --all --filter name='^/roottestreloadclientcertificate-gw8-.*-1$' --format '{{.ID}}:{{.Names}}'] Trying to prune unused networks... Command:[docker container list --all --filter name='^/roottestreloadclientcertificate-gw8-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestpostgresqlreplicadatabaseengine1-gw1-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestpostgresqlreplicadatabaseengine1-gw1-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottests3tablefunctionwithhttpproxy-gw6 No running containers for project: roottests3tablefunctionwithhttpproxy-gw6 Trying to prune unused networks... Trying to prune unused networks... Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestscheduler-gw3 No running containers for project: roottestscheduler-gw3 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Trying to prune unused images... Trying to prune unused images... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Command:[docker image prune -f] Command:[docker image prune -f] Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestpostgresqlreplicadatabaseengine1-gw1 No running containers for project: roottestpostgresqlreplicadatabaseengine1-gw1 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestreloadclientcertificate-gw8 No running containers for project: roottestreloadclientcertificate-gw8 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stderr:Error response from daemon: a prune operation is already running Stderr:Error response from daemon: a prune operation is already running Exitcode:1 Exitcode:1 Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stderr:Error response from daemon: a prune operation is already running Stderr:Error response from daemon: a prune operation is already running Exitcode:1 Exitcode:1 Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stderr:Error response from daemon: a prune operation is already running Stderr:Error response from daemon: a prune operation is already running Exitcode:1 Exitcode:1 Trying to prune unused volumes... Trying to prune unused volumes... Stdout:Total reclaimed space: 0B Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stderr:Error response from daemon: a prune operation is already running Stderr:Error response from daemon: a prune operation is already running Exitcode:1 Exitcode:1 Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:1 Stdout:1 Volumes pruned: 1 Volumes pruned: 1 Setup directory for instance: node1 Setup directory for instance: node1 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Stdout:1 Stdout:1 Volumes pruned: 1 Volumes pruned: 1 Setup directory for instance: node1 Setup directory for instance: node1 Generate and write macros file Generate and write macros file Stdout:1 Stdout:1 Volumes pruned: 1 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Volumes pruned: 1 Create directory for common tests configuration Copy custom test config files ['/ClickHouse/tests/integration/test_rename_column/configs/remote_servers.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/instant_moves.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/part_log.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/zookeeper_session_timeout.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/storage_configuration.xml'] to /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node1/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_rename_column/configs/remote_servers.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/instant_moves.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/part_log.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/zookeeper_session_timeout.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/storage_configuration.xml'] to /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node1/configs/config.d Create directory for common tests configuration Setup directory for instance: node Setup directory for instance: node Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Create directory for configuration generated in this helper Copy custom test config files ['/ClickHouse/tests/integration/test_s3_low_cardinality_right_border/configs/s3.xml'] to /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw9/node1/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_s3_low_cardinality_right_border/configs/s3.xml'] to /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw9/node1/configs/config.d Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Setup database dir /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw9/node1/database Setup database dir /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw9/node1/database Copy common configuration from helpers Setup logs dir /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw9/node1/logs Setup logs dir /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw9/node1/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Stdout:1 Stdout:1 Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw9/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw9/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw9/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw9/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw9/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw9/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw9/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw9/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw9/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw9/.env Volumes pruned: 1 Volumes pruned: 1 Setup directory for instance: node1 Setup directory for instance: node1 Generate and write macros file Generate and write macros file Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Setup database dir /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node1/database No config file found Setup database dir /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node1/database No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Copy custom test config files ['/ClickHouse/tests/integration/test_rocksdb_options/configs/rocksdb.xml'] to /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw4/node/configs/config.d Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Copy custom test config files ['/ClickHouse/tests/integration/test_rocksdb_options/configs/rocksdb.xml'] to /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw4/node/configs/config.d No config file found Create directory for configuration generated in this helper No config file found Create directory for configuration generated in this helper Setup logs dir /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node1/logs Setup logs dir /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node1/logs Create directory for common tests configuration Create directory for common tests configuration Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Copy common configuration from helpers Setup directory for instance: node2 Copy common configuration from helpers Setup directory for instance: node2 Images pruned Images pruned Setup database dir /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw4/node/database Setup database dir /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw4/node/database Trying to prune unused volumes... Trying to prune unused volumes... Setup logs dir /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw4/node/logs Setup logs dir /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw4/node/logs Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" Command:[docker volume ls | wc -l] Generate and write macros file Create directory for configuration generated in this helper Command:[docker volume ls | wc -l] Generate and write macros file Create directory for configuration generated in this helper Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw'} stored in /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw4/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw'} stored in /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw4/.env Create directory for common tests configuration Create directory for common tests configuration Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Copy common configuration from helpers Copy common configuration from helpers No config file found No config file found Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_user_defined_functions/configs/config.xml'] to /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node1/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_user_defined_functions/configs/config.xml'] to /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node1/configs/config.d Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found Setup database dir /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node1/database Generate and write macros file Generate and write macros file Setup database dir /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node1/database Setup logs dir /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node1/logs Setup logs dir /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node1/logs Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" Copy custom test config files ['/ClickHouse/tests/integration/test_rename_column/configs/remote_servers.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/instant_moves.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/part_log.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/zookeeper_session_timeout.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/storage_configuration.xml'] to /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node2/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_rename_column/configs/remote_servers.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/instant_moves.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/part_log.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/zookeeper_session_timeout.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/storage_configuration.xml'] to /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node2/configs/config.d Setup directory for instance: node2 Setup directory for instance: node2 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Setup database dir /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node2/database Setup database dir /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node2/database Create directory for common tests configuration Create directory for common tests configuration Setup logs dir /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node2/logs Setup logs dir /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node2/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Copy common configuration from helpers Copy common configuration from helpers Setup directory for instance: node3 Setup directory for instance: node3 No config file found Generate and write macros file Generate and write macros file Create directory for configuration generated in this helper Create directory for configuration generated in this helper Stdout:1 Stdout:1 Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_user_defined_functions/configs/config.xml'] to /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node2/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_user_defined_functions/configs/config.xml'] to /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node2/configs/config.d Create directory for common tests configuration Create directory for common tests configuration Setup database dir /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node2/database Setup database dir /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node2/database Volumes pruned: 1 Volumes pruned: 1 Copy common configuration from helpers Copy common configuration from helpers Setup directory for instance: remote_proxy_node Setup logs dir /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node2/logs Setup directory for instance: remote_proxy_node Setup logs dir /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node2/logs Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" Generate and write macros file Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper3/coordination'} stored in /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env Generate and write macros file Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper3/coordination'} stored in /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env Copy custom test config files ['/ClickHouse/tests/integration/test_rename_column/configs/remote_servers.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/instant_moves.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/part_log.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/zookeeper_session_timeout.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/storage_configuration.xml'] to /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node3/configs/config.d Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Create directory for configuration generated in this helper Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Create directory for configuration generated in this helper Copy custom test config files ['/ClickHouse/tests/integration/test_rename_column/configs/remote_servers.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/instant_moves.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/part_log.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/zookeeper_session_timeout.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/storage_configuration.xml'] to /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node3/configs/config.d No config file found No config file found Create directory for common tests configuration Create directory for common tests configuration Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Copy common configuration from helpers Copy common configuration from helpers Setup database dir /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node3/database Setup database dir /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node3/database Setup logs dir /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node3/logs Setup logs dir /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node3/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Generate and write macros file Generate and write macros file Setup directory for instance: node4 Setup directory for instance: node4 Copy custom test config files ['/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/configs/config.d/proxy_remote.xml'] to /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/configs/config.d/proxy_remote.xml'] to /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node/configs/config.d Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Setup database dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node/database Setup database dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node/database Setup logs dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node/logs Setup logs dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node/logs Generate and write macros file Generate and write macros file Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Setup directory for instance: remote_proxy_node_no_proxy Setup directory for instance: remote_proxy_node_no_proxy Copy custom test config files ['/ClickHouse/tests/integration/test_rename_column/configs/remote_servers.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/instant_moves.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/part_log.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/zookeeper_session_timeout.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/storage_configuration.xml'] to /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node4/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_rename_column/configs/remote_servers.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/instant_moves.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/part_log.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/zookeeper_session_timeout.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/storage_configuration.xml'] to /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node4/configs/config.d Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Setup database dir /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node4/database Setup database dir /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node4/database Copy common configuration from helpers Copy common configuration from helpers Setup logs dir /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node4/logs Setup logs dir /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node4/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/keeper3/coordination'} stored in /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/keeper3/coordination'} stored in /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/.env Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/configs/config.d/proxy_remote_no_proxy.xml'] to /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node_no_proxy/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/configs/config.d/proxy_remote_no_proxy.xml'] to /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node_no_proxy/configs/config.d Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Setup database dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node_no_proxy/database Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Setup database dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node_no_proxy/database No config file found No config file found Setup logs dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node_no_proxy/logs Setup logs dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node_no_proxy/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Setup directory for instance: proxy_list_node Setup directory for instance: proxy_list_node Stdout:1 Stdout:1 http://localhost:None "GET /version HTTP/1.1" 200 826 Volumes pruned: 1 Volumes pruned: 1 http://localhost:None "GET /version HTTP/1.1" 200 826 Setup directory for instance: node Setup directory for instance: node Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw9/.env --project-name roottests3lowcardinalityrightborder-gw9 --file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw9/.env --project-name roottests3lowcardinalityrightborder-gw9 --file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml pull] Copy common configuration from helpers Copy common configuration from helpers Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Generate and write macros file Generate and write macros file Copy common configuration from helpers Copy common configuration from helpers Copy custom test config files ['/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/configs/config.d/proxy_list.xml'] to /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/configs/config.d/proxy_list.xml'] to /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node/configs/config.d Setup database dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node/database Setup database dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node/database Setup logs dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node/logs Setup logs dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node/logs Generate and write macros file Generate and write macros file Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Setup directory for instance: proxy_list_node_no_proxy Setup directory for instance: proxy_list_node_no_proxy Copy custom test config files ['/ClickHouse/tests/integration/test_scheduler/configs/storage_configuration.xml', '/ClickHouse/tests/integration/test_scheduler/configs/resources.xml', '/ClickHouse/tests/integration/test_scheduler/configs/resources.xml.default', '/ClickHouse/tests/integration/test_scheduler/configs/workloads.xml', '/ClickHouse/tests/integration/test_scheduler/configs/workloads.xml.default'] to /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/node/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_scheduler/configs/storage_configuration.xml', '/ClickHouse/tests/integration/test_scheduler/configs/resources.xml', '/ClickHouse/tests/integration/test_scheduler/configs/resources.xml.default', '/ClickHouse/tests/integration/test_scheduler/configs/workloads.xml', '/ClickHouse/tests/integration/test_scheduler/configs/workloads.xml.default'] to /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/node/configs/config.d http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Command:[docker compose --env-file /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw4/.env --project-name roottestrocksdboptions-gw4 --file /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw4/node/docker-compose.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw4/.env --project-name roottestrocksdboptions-gw4 --file /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw4/node/docker-compose.yml pull] Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/configs/config.d/proxy_list_no_proxy.xml'] to /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node_no_proxy/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/configs/config.d/proxy_list_no_proxy.xml'] to /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node_no_proxy/configs/config.d Setup database dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node_no_proxy/database Setup database dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node_no_proxy/database Setup logs dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node_no_proxy/logs Setup logs dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node_no_proxy/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Setup database dir /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/node/database Setup database dir /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/node/database Setup directory for instance: env_node Setup directory for instance: env_node Setup logs dir /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/node/logs Setup logs dir /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/node/logs Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" Create directory for configuration generated in this helper Create directory for configuration generated in this helper Setup directory for instance: node2 Setup directory for instance: node2 Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Generate and write macros file Generate and write macros file Copy common configuration from helpers Copy common configuration from helpers http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Stdout:1 Stdout:1 Copy custom test config files [] to /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node/configs/config.d Copy custom test config files [] to /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node/configs/config.d Volumes pruned: 1 Volumes pruned: 1 Setup database dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node/database Setup database dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node/database Setup directory for instance: node1 Setup directory for instance: node1 Setup logs dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node/logs Setup logs dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node/logs Generate and write macros file Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Generate and write macros file Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/resolver', 'RESOLVER_LOGS_FS': 'bind', 'http_proxy': 'http://proxy1'} stored in /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/resolver', 'RESOLVER_LOGS_FS': 'bind', 'http_proxy': 'http://proxy1'} stored in /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node/.env Create directory for configuration generated in this helper Create directory for configuration generated in this helper Setup directory for instance: env_node_no_proxy Copy custom test config files ['/ClickHouse/tests/integration/test_scheduler/configs/storage_configuration.xml', '/ClickHouse/tests/integration/test_scheduler/configs/resources.xml', '/ClickHouse/tests/integration/test_scheduler/configs/resources.xml.default', '/ClickHouse/tests/integration/test_scheduler/configs/workloads.xml', '/ClickHouse/tests/integration/test_scheduler/configs/workloads.xml.default'] to /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/node2/configs/config.d Setup directory for instance: env_node_no_proxy Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --project-name roottestreplicateduserdefinedfunctions-gw2 --file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node2/docker-compose.yml pull] Copy custom test config files ['/ClickHouse/tests/integration/test_scheduler/configs/storage_configuration.xml', '/ClickHouse/tests/integration/test_scheduler/configs/resources.xml', '/ClickHouse/tests/integration/test_scheduler/configs/resources.xml.default', '/ClickHouse/tests/integration/test_scheduler/configs/workloads.xml', '/ClickHouse/tests/integration/test_scheduler/configs/workloads.xml.default'] to /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/node2/configs/config.d Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --project-name roottestreplicateduserdefinedfunctions-gw2 --file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node2/docker-compose.yml pull] Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Create directory for configuration generated in this helper Create directory for configuration generated in this helper Setup database dir /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/node2/database Create directory for common tests configuration Create directory for common tests configuration Setup database dir /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/node2/database Setup logs dir /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/node2/logs Setup logs dir /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/node2/logs Copy common configuration from helpers Copy common configuration from helpers Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" Generate and write macros file Generate and write macros file Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/keeper3/coordination', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/keeper3/coordination', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/.env Generate and write macros file Generate and write macros file Copy custom test config files [] to /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node_no_proxy/configs/config.d Copy custom test config files [] to /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node_no_proxy/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/configs/config.d/storage_conf.xml'] to /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node1/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/configs/config.d/storage_conf.xml'] to /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node1/configs/config.d Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Setup database dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node_no_proxy/database Setup database dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node_no_proxy/database No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Setup logs dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node_no_proxy/logs Setup logs dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node_no_proxy/logs No config file found No config file found Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/resolver', 'RESOLVER_LOGS_FS': 'bind', 'http_proxy': 'http://proxy1', 'no_proxy': 'not_important_host,, minio1 ,'} stored in /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node_no_proxy/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/resolver', 'RESOLVER_LOGS_FS': 'bind', 'http_proxy': 'http://proxy1', 'no_proxy': 'not_important_host,, minio1 ,'} stored in /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node_no_proxy/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/.env http://localhost:None "GET /version HTTP/1.1" 200 826 Setup database dir /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node1/database http://localhost:None "GET /version HTTP/1.1" 200 826 Setup database dir /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node1/database Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Setup logs dir /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node1/logs Setup logs dir /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node1/logs No config file found No config file found Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Setup directory for instance: node2 Setup directory for instance: node2 Command:[docker compose --env-file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/.env --project-name roottestrenamecolumn-gw0 --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node3/docker-compose.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node4/docker-compose.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/.env --project-name roottestrenamecolumn-gw0 --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node3/docker-compose.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node4/docker-compose.yml pull] Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/configs/config.d/storage_conf.xml'] to /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node2/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/configs/config.d/storage_conf.xml'] to /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node2/configs/config.d Setup database dir /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node2/database Setup database dir /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node2/database Setup logs dir /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node2/logs Setup logs dir /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node2/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Setup directory for instance: node3 Setup directory for instance: node3 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/configs/config.d/storage_conf.xml'] to /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node3/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/configs/config.d/storage_conf.xml'] to /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node3/configs/config.d Setup database dir /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node3/database Setup database dir /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node3/database Stdout:1 Stdout:1 Setup logs dir /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node3/logs Setup logs dir /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node3/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Volumes pruned: 1 Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/keeper3/coordination', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/keeper3/coordination', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/.env Volumes pruned: 1 Setup directory for instance: instance Setup directory for instance: instance Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/configs/log_conf.xml'] to /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw1/instance/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/configs/log_conf.xml'] to /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw1/instance/configs/config.d http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Setup database dir /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw1/instance/database Setup database dir /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw1/instance/database Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/.env --project-name roottests3tablefunctionwithhttpproxy-gw6 --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node_no_proxy/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node_no_proxy/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node_no_proxy/docker-compose.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/.env --project-name roottests3tablefunctionwithhttpproxy-gw6 --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node_no_proxy/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node_no_proxy/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node_no_proxy/docker-compose.yml pull] Setup logs dir /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw1/instance/logs Setup logs dir /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw1/instance/logs Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'POSTGRES_PORT': '5432', 'POSTGRES_DIR': '/ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw1/postgres/postgres1', 'POSTGRES_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw1/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'POSTGRES_PORT': '5432', 'POSTGRES_DIR': '/ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw1/postgres/postgres1', 'POSTGRES_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw1/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Command:[docker compose --env-file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/.env --project-name roottestscheduler-gw3 --file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/node2/docker-compose.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/.env --project-name roottestscheduler-gw3 --file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/node2/docker-compose.yml pull] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/.env --project-name roottestreplicatedmergetrees3zerocopy-gw5 --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node3/docker-compose.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/.env --project-name roottestreplicatedmergetrees3zerocopy-gw5 --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node3/docker-compose.yml pull] http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw1/.env --project-name roottestpostgresqlreplicadatabaseengine1-gw1 --file /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw1/instance/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_postgres.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw1/.env --project-name roottestpostgresqlreplicadatabaseengine1-gw1 --file /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw1/instance/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_postgres.yml pull] Stdout:1 Stdout:1 Volumes pruned: 1 Volumes pruned: 1 Setup directory for instance: node1 Setup directory for instance: node1 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/first_client.crt', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/first_client.key', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/second_client.crt', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/second_client.key', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/third_client.crt', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/third_client.key', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/conf.d/remote_servers.xml', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/conf.d/ssl_conf.xml', '/ClickHouse/tests/integration/test_reload_client_certificate/configs/zookeeper_config_with_ssl.xml'] to /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/node1/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/first_client.crt', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/first_client.key', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/second_client.crt', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/second_client.key', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/third_client.crt', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/third_client.key', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/conf.d/remote_servers.xml', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/conf.d/ssl_conf.xml', '/ClickHouse/tests/integration/test_reload_client_certificate/configs/zookeeper_config_with_ssl.xml'] to /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/node1/configs/config.d Setup database dir /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/node1/database Setup database dir /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/node1/database Setup logs dir /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/node1/logs Setup logs dir /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/node1/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Setup directory for instance: node2 Setup directory for instance: node2 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/first_client.crt', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/first_client.key', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/second_client.crt', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/second_client.key', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/third_client.crt', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/third_client.key', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/conf.d/remote_servers.xml', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/conf.d/ssl_conf.xml', '/ClickHouse/tests/integration/test_reload_client_certificate/configs/zookeeper_config_with_ssl.xml'] to /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/node2/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/first_client.crt', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/first_client.key', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/second_client.crt', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/second_client.key', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/third_client.crt', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/third_client.key', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/conf.d/remote_servers.xml', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/conf.d/ssl_conf.xml', '/ClickHouse/tests/integration/test_reload_client_certificate/configs/zookeeper_config_with_ssl.xml'] to /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/node2/configs/config.d Setup database dir /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/node2/database Setup database dir /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/node2/database Setup logs dir /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/node2/logs Setup logs dir /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/node2/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'ZOO_SECURE_CLIENT_PORT': '2281', 'ZK_FS': 'bind', 'ZK_DATA1': '/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/zk1/data', 'ZK_DATA_LOG1': '/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/zk1/log', 'ZK_DATA2': '/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/zk2/data', 'ZK_DATA_LOG2': '/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/zk2/log', 'ZK_DATA3': '/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/zk3/data', 'ZK_DATA_LOG3': '/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/zk3/log'} stored in /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'ZOO_SECURE_CLIENT_PORT': '2281', 'ZK_FS': 'bind', 'ZK_DATA1': '/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/zk1/data', 'ZK_DATA_LOG1': '/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/zk1/log', 'ZK_DATA2': '/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/zk2/data', 'ZK_DATA_LOG2': '/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/zk2/log', 'ZK_DATA3': '/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/zk3/data', 'ZK_DATA_LOG3': '/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/zk3/log'} stored in /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --project-name roottestreloadclientcertificate-gw8 --file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml --file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/node2/docker-compose.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --project-name roottestreloadclientcertificate-gw8 --file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml --file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/node2/docker-compose.yml pull] Stdout:Deleted Networks: Stdout:Deleted Networks: Stdout:roottestmysqlprotocol-gw0_default Stdout:roottestmysqlprotocol-gw0_default Stdout: Stdout: Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] Stdout:net.ipv4.ip_local_port_range = 55000 65535 Stdout:net.ipv4.ip_local_port_range = 55000 65535 Running tests in /ClickHouse/tests/integration/test_reload_clusters_config/test.py Running tests in /ClickHouse/tests/integration/test_reload_clusters_config/test.py Cluster start called. is_up=False Cluster start called. is_up=False Docker networks for project roottestreloadclustersconfig-gw7 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreloadclustersconfig-gw7 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestreloadclustersconfig-gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreloadclustersconfig-gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreloadclustersconfig-gw7 are DRIVER VOLUME NAME Docker volumes for project roottestreloadclustersconfig-gw7 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker networks for project roottestreloadclustersconfig-gw7 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreloadclustersconfig-gw7 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestreloadclustersconfig-gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreloadclustersconfig-gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreloadclustersconfig-gw7 are DRIVER VOLUME NAME Docker volumes for project roottestreloadclustersconfig-gw7 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestreloadclustersconfig-gw7-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestreloadclustersconfig-gw7-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestreloadclustersconfig-gw7 No running containers for project: roottestreloadclustersconfig-gw7 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:1 Stdout:1 Volumes pruned: 1 Volumes pruned: 1 Setup directory for instance: node Setup directory for instance: node Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_reload_clusters_config/configs/remote_servers.xml'] to /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/node/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_reload_clusters_config/configs/remote_servers.xml'] to /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/node/configs/config.d Setup database dir /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/node/database Setup database dir /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/node/database Setup logs dir /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/node/logs Setup logs dir /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/node/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/keeper3/coordination'} stored in /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/keeper3/coordination'} stored in /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/.env --project-name roottestreloadclustersconfig-gw7 --file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/.env --project-name roottestreloadclustersconfig-gw7 --file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml pull] Stderr: zoo1 Skipped - Image is already being pulled by zoo3 Stderr: zoo1 Skipped - Image is already being pulled by zoo3 Stderr: zoo2 Skipped - Image is already being pulled by zoo3 Stderr: zoo2 Skipped - Image is already being pulled by zoo3 Stderr: node2 Skipped - Image is already being pulled by zoo3 Stderr: node2 Skipped - Image is already being pulled by zoo3 Stderr: node3 Skipped - Image is already being pulled by zoo3 Stderr: node3 Skipped - Image is already being pulled by zoo3 Stderr: node4 Skipped - Image is already being pulled by zoo3 Stderr: node4 Skipped - Image is already being pulled by zoo3 Stderr: node1 Skipped - Image is already being pulled by zoo3 Stderr: node1 Skipped - Image is already being pulled by zoo3 Stderr: zoo3 Pulling Stderr: zoo3 Pulling Stderr: zoo3 Pulled Stderr: zoo3 Pulled Setup ZooKeeper Setup ZooKeeper Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/keeper1/log', '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/keeper1/config', '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/keeper1/coordination', '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/keeper2/log', '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/keeper2/config', '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/keeper2/coordination', '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/keeper3/log', '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/keeper3/config', '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/keeper3/coordination'] Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/keeper1/log', '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/keeper1/config', '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/keeper1/coordination', '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/keeper2/log', '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/keeper2/config', '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/keeper2/coordination', '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/keeper3/log', '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/keeper3/config', '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/keeper3/coordination'] Command:[docker compose --project-name roottestrenamecolumn-gw0 --env-file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Command:[docker compose --project-name roottestrenamecolumn-gw0 --env-file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Stderr: node Pulling Stderr: node Pulling Stderr: node Pulled Stderr: node Pulled ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw4/.env --project-name roottestrocksdboptions-gw4 --file /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw4/node/docker-compose.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw4/.env --project-name roottestrocksdboptions-gw4 --file /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw4/node/docker-compose.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw4/.env --project-name roottestrocksdboptions-gw4 --file /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw4/node/docker-compose.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw4/.env --project-name roottestrocksdboptions-gw4 --file /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw4/node/docker-compose.yml up -d --no-recreate] Stderr: node Skipped - Image is already being pulled by zoo3 Stderr: node Skipped - Image is already being pulled by zoo3 Stderr: zoo1 Skipped - Image is already being pulled by zoo3 Stderr: zoo1 Skipped - Image is already being pulled by zoo3 Stderr: zoo2 Skipped - Image is already being pulled by zoo3 Stderr: zoo2 Skipped - Image is already being pulled by zoo3 Stderr: zoo3 Pulling Stderr: zoo3 Pulling Stderr: zoo3 Pulled Stderr: zoo3 Pulled Setup ZooKeeper Setup ZooKeeper Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/keeper1/log', '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/keeper1/config', '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/keeper1/coordination', '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/keeper2/log', '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/keeper2/config', '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/keeper2/coordination', '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/keeper3/log', '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/keeper3/config', '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/keeper3/coordination'] Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/keeper1/log', '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/keeper1/config', '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/keeper1/coordination', '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/keeper2/log', '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/keeper2/config', '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/keeper2/coordination', '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/keeper3/log', '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/keeper3/config', '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/keeper3/coordination'] Command:[docker compose --project-name roottestreloadclustersconfig-gw7 --env-file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Command:[docker compose --project-name roottestreloadclustersconfig-gw7 --env-file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Stderr: postgres1 Pulling Stderr: postgres1 Pulling Stderr: instance Pulling Stderr: instance Pulling Stderr: instance Pulled Stderr: instance Pulled Stderr: postgres1 Pulled Stderr: postgres1 Pulled Setup Postgres Setup Postgres Command:[docker compose --project-name roottestpostgresqlreplicadatabaseengine1-gw1 --env-file /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw1/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_postgres.yml --verbose up -d] Command:[docker compose --project-name roottestpostgresqlreplicadatabaseengine1-gw1 --env-file /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw1/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_postgres.yml --verbose up -d] Stderr: zoo1 Skipped - Image is already being pulled by zoo3 Stderr: zoo1 Skipped - Image is already being pulled by zoo3 Stderr: zoo2 Skipped - Image is already being pulled by zoo3 Stderr: zoo2 Skipped - Image is already being pulled by zoo3 Stderr: node1 Skipped - Image is already being pulled by node2 Stderr: node1 Skipped - Image is already being pulled by node2 Stderr: node2 Pulling Stderr: node2 Pulling Stderr: zoo3 Pulling Stderr: zoo3 Pulling Stderr: zoo3 Pulled Stderr: zoo3 Pulled Stderr: node2 Pulled Stderr: node2 Pulled Setup ZooKeeper Secure Setup ZooKeeper Secure Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/zk1/data', '/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/zk1/log', '/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/zk2/data', '/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/zk2/log', '/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/zk3/data', '/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/zk3/log'] Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/zk1/data', '/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/zk1/log', '/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/zk2/data', '/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/zk2/log', '/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/zk3/data', '/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/zk3/log'] Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml --verbose up -d] Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml --verbose up -d] Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: zoo1 Skipped - Image is already being pulled by node2 Stderr: zoo1 Skipped - Image is already being pulled by node2 Stderr: zoo3 Skipped - Image is already being pulled by node2 Stderr: zoo3 Skipped - Image is already being pulled by node2 Stderr: zoo2 Skipped - Image is already being pulled by node2 Stderr: zoo2 Skipped - Image is already being pulled by node2 Stderr: node1 Skipped - Image is already being pulled by node2 Stderr: node1 Skipped - Image is already being pulled by node2 Stderr: node3 Skipped - Image is already being pulled by node2 Stderr: node3 Skipped - Image is already being pulled by node2 Stderr: resolver Pulling Stderr: resolver Pulling Stderr: proxy1 Pulling Stderr: proxy1 Pulling Stderr: node2 Pulling Stderr: node2 Pulling Stderr: minio1 Pulling Stderr: minio1 Pulling Stderr: resolver Pulled Stderr: resolver Pulled Stderr: minio1 Pulled Stderr: minio1 Pulled Stderr: proxy1 Pulled Stderr: proxy1 Pulled Stderr: node2 Pulled Stderr: node2 Pulled Setup ZooKeeper Setup ZooKeeper Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/keeper1/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/keeper1/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/keeper1/coordination', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/keeper2/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/keeper2/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/keeper2/coordination', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/keeper3/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/keeper3/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/keeper3/coordination'] Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/keeper1/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/keeper1/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/keeper1/coordination', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/keeper2/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/keeper2/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/keeper2/coordination', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/keeper3/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/keeper3/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/keeper3/coordination'] Command:[docker compose --project-name roottestreplicatedmergetrees3zerocopy-gw5 --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Command:[docker compose --project-name roottestreplicatedmergetrees3zerocopy-gw5 --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Stderr: proxy1 Skipped - Image is already being pulled by proxy2 Stderr: proxy1 Skipped - Image is already being pulled by proxy2 Stderr: minio1 Pulling Stderr: minio1 Pulling Stderr: proxy2 Pulling Stderr: proxy2 Pulling Stderr: node1 Pulling Stderr: node1 Pulling Stderr: resolver Pulling Stderr: resolver Pulling Stderr: proxy2 Pulled Stderr: proxy2 Pulled Stderr: node1 Pulled Stderr: node1 Pulled Stderr: resolver Pulled Stderr: resolver Pulled Stderr: minio1 Pulled Stderr: minio1 Pulled Trying to create Minio instance by command docker compose --project-name roottests3lowcardinalityrightborder-gw9 --env-file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Trying to create Minio instance by command docker compose --project-name roottests3lowcardinalityrightborder-gw9 --env-file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Command:[docker compose --project-name roottests3lowcardinalityrightborder-gw9 --env-file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Command:[docker compose --project-name roottests3lowcardinalityrightborder-gw9 --env-file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Stderr: zoo1 Skipped - Image is already being pulled by node2 Stderr: zoo1 Skipped - Image is already being pulled by node2 Stderr: zoo3 Skipped - Image is already being pulled by node2 Stderr: zoo3 Skipped - Image is already being pulled by node2 Stderr: node Skipped - Image is already being pulled by node2 Stderr: node Skipped - Image is already being pulled by node2 Stderr: zoo2 Skipped - Image is already being pulled by node2 Stderr: zoo2 Skipped - Image is already being pulled by node2 Stderr: proxy1 Skipped - Image is already being pulled by proxy2 Stderr: proxy1 Skipped - Image is already being pulled by proxy2 Stderr: proxy2 Pulling Stderr: proxy2 Pulling Stderr: minio1 Pulling Stderr: minio1 Pulling Stderr: node2 Pulling Stderr: node2 Pulling Stderr: resolver Pulling Stderr: resolver Pulling Stderr: resolver Pulled Stderr: resolver Pulled Stderr: proxy2 Pulled Stderr: proxy2 Pulled Stderr: minio1 Pulled Stderr: minio1 Pulled Stderr: node2 Pulled Stderr: node2 Pulled Setup ZooKeeper Setup ZooKeeper Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/keeper1/log', '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/keeper1/config', '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/keeper1/coordination', '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/keeper2/log', '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/keeper2/config', '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/keeper2/coordination', '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/keeper3/log', '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/keeper3/config', '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/keeper3/coordination'] Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/keeper1/log', '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/keeper1/config', '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/keeper1/coordination', '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/keeper2/log', '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/keeper2/config', '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/keeper2/coordination', '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/keeper3/log', '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/keeper3/config', '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/keeper3/coordination'] Command:[docker compose --project-name roottestscheduler-gw3 --env-file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Command:[docker compose --project-name roottestscheduler-gw3 --env-file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Stderr: node2 Skipped - Image is already being pulled by zoo3 Stderr: node2 Skipped - Image is already being pulled by zoo3 Stderr: node1 Skipped - Image is already being pulled by zoo3 Stderr: node1 Skipped - Image is already being pulled by zoo3 Stderr: zoo1 Skipped - Image is already being pulled by zoo3 Stderr: zoo1 Skipped - Image is already being pulled by zoo3 Stderr: zoo2 Skipped - Image is already being pulled by zoo3 Stderr: zoo2 Skipped - Image is already being pulled by zoo3 Stderr: zoo3 Pulling Stderr: zoo3 Pulling Stderr: zoo3 Pulled Stderr: zoo3 Pulled Setup ZooKeeper Setup ZooKeeper Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper1/log', '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper1/config', '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper1/coordination', '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper2/log', '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper2/config', '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper2/coordination', '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper3/log', '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper3/config', '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper3/coordination'] Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper1/log', '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper1/config', '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper1/coordination', '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper2/log', '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper2/config', '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper2/coordination', '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper3/log', '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper3/config', '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper3/coordination'] Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: env_node Skipped - Image is already being pulled by env_node_no_proxy Stderr: env_node Skipped - Image is already being pulled by env_node_no_proxy Stderr: proxy_list_node_no_proxy Skipped - Image is already being pulled by env_node_no_proxy Stderr: proxy_list_node_no_proxy Skipped - Image is already being pulled by env_node_no_proxy Stderr: remote_proxy_node_no_proxy Skipped - Image is already being pulled by env_node_no_proxy Stderr: remote_proxy_node_no_proxy Skipped - Image is already being pulled by env_node_no_proxy Stderr: proxy_list_node Skipped - Image is already being pulled by env_node_no_proxy Stderr: proxy_list_node Skipped - Image is already being pulled by env_node_no_proxy Stderr: remote_proxy_node Skipped - Image is already being pulled by env_node_no_proxy Stderr: remote_proxy_node Skipped - Image is already being pulled by env_node_no_proxy Stderr: resolver Pulling Stderr: resolver Pulling Stderr: env_node_no_proxy Pulling Stderr: env_node_no_proxy Pulling Stderr: minio1 Pulling Stderr: minio1 Pulling Stderr: proxy1 Pulling Stderr: proxy1 Pulling Stderr: minio1 Pulled Stderr: minio1 Pulled Stderr: env_node_no_proxy Pulled Stderr: env_node_no_proxy Pulled Stderr: proxy1 Pulled Stderr: proxy1 Pulled Stderr: resolver Pulled Stderr: resolver Pulled Trying to create Minio instance by command docker compose --project-name roottests3tablefunctionwithhttpproxy-gw6 --env-file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Trying to create Minio instance by command docker compose --project-name roottests3tablefunctionwithhttpproxy-gw6 --env-file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Command:[docker compose --project-name roottests3tablefunctionwithhttpproxy-gw6 --env-file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Command:[docker compose --project-name roottests3tablefunctionwithhttpproxy-gw6 --env-file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Stderr: Network roottestrocksdboptions-gw4_default Creating Stderr: Network roottestrocksdboptions-gw4_default Creating Stderr: Network roottestrocksdboptions-gw4_default Created Stderr: Network roottestrocksdboptions-gw4_default Created Stderr: Container roottestrocksdboptions-gw4-node-1 Creating Stderr: Container roottestrocksdboptions-gw4-node-1 Creating Stderr: Container roottestrocksdboptions-gw4-node-1 Created Stderr: Container roottestrocksdboptions-gw4-node-1 Created Stderr: Container roottestrocksdboptions-gw4-node-1 Starting Stderr: Container roottestrocksdboptions-gw4-node-1 Starting Stderr: Container roottestrocksdboptions-gw4-node-1 Started Stderr: Container roottestrocksdboptions-gw4-node-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottestrocksdboptions-gw4-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrocksdboptions-gw4-node-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottestrocksdboptions-gw4-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrocksdboptions-gw4-node-1/json HTTP/1.1" 200 None Stderr:time="2025-04-02T02:52:46Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:52:46Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottestrenamecolumn-gw0_default Creating Stderr: Network roottestrenamecolumn-gw0_default Creating Waiting for ClickHouse start in node, ip: 172.16.2.2... Waiting for ClickHouse start in node, ip: 172.16.2.2... Stderr: Network roottestrenamecolumn-gw0_default Created Stderr: Network roottestrenamecolumn-gw0_default Created Stderr: Container roottestrenamecolumn-gw0-zoo2-1 Creating Stderr: Container roottestrenamecolumn-gw0-zoo2-1 Creating Stderr: Container roottestrenamecolumn-gw0-zoo3-1 Creating Stderr: Container roottestrenamecolumn-gw0-zoo3-1 Creating Stderr: Container roottestrenamecolumn-gw0-zoo1-1 Creating Stderr: Container roottestrenamecolumn-gw0-zoo1-1 Creating Stderr: Container roottestrenamecolumn-gw0-zoo3-1 Created Stderr: Container roottestrenamecolumn-gw0-zoo3-1 Created Stderr: Container roottestrenamecolumn-gw0-zoo1-1 Created Stderr: Container roottestrenamecolumn-gw0-zoo1-1 Created Stderr: Container roottestrenamecolumn-gw0-zoo2-1 Created Stderr: Container roottestrenamecolumn-gw0-zoo2-1 Created Stderr: Container roottestrenamecolumn-gw0-zoo2-1 Starting Stderr: Container roottestrenamecolumn-gw0-zoo2-1 Starting Stderr: Container roottestrenamecolumn-gw0-zoo3-1 Starting Stderr: Container roottestrenamecolumn-gw0-zoo3-1 Starting Stderr: Container roottestrenamecolumn-gw0-zoo1-1 Starting Stderr: Container roottestrenamecolumn-gw0-zoo1-1 Starting Stderr: Container roottestrenamecolumn-gw0-zoo3-1 Started Stderr: Container roottestrenamecolumn-gw0-zoo3-1 Started Stderr: Container roottestrenamecolumn-gw0-zoo1-1 Started Stderr: Container roottestrenamecolumn-gw0-zoo1-1 Started Stderr: Container roottestrenamecolumn-gw0-zoo2-1 Started Stderr: Container roottestrenamecolumn-gw0-zoo2-1 Started Stderr:time="2025-04-02T02:52:47Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:52:47Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:52:47Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:52:47Z" level=debug msg="otel error" error="" Wait ZooKeeper to start Wait ZooKeeper to start get_instance_ip instance_name=zoo1 get_instance_ip instance_name=zoo1 http://localhost:None "GET /v1.46/containers/roottestrocksdboptions-gw4-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrocksdboptions-gw4-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw0-zoo1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw0-zoo1-1/json HTTP/1.1" 200 None get_kazoo_client: zoo1, ip:172.16.1.4, port:2181, use_ssl:False get_kazoo_client: zoo1, ip:172.16.1.4, port:2181, use_ssl:False http://localhost:None "GET /v1.46/containers/2da00efe3b92dbd74d75c5b4f1b1b6ba6bc9bcc037d843952c80b4f7f8737357/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2da00efe3b92dbd74d75c5b4f1b1b6ba6bc9bcc037d843952c80b4f7f8737357/json HTTP/1.1" 200 None Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/2da00efe3b92dbd74d75c5b4f1b1b6ba6bc9bcc037d843952c80b4f7f8737357/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2da00efe3b92dbd74d75c5b4f1b1b6ba6bc9bcc037d843952c80b4f7f8737357/json HTTP/1.1" 200 None Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/2da00efe3b92dbd74d75c5b4f1b1b6ba6bc9bcc037d843952c80b4f7f8737357/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2da00efe3b92dbd74d75c5b4f1b1b6ba6bc9bcc037d843952c80b4f7f8737357/json HTTP/1.1" 200 None Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/2da00efe3b92dbd74d75c5b4f1b1b6ba6bc9bcc037d843952c80b4f7f8737357/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2da00efe3b92dbd74d75c5b4f1b1b6ba6bc9bcc037d843952c80b4f7f8737357/json HTTP/1.1" 200 None Stderr:time="2025-04-02T02:52:46Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:52:46Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottestreloadclustersconfig-gw7_default Creating Stderr: Network roottestreloadclustersconfig-gw7_default Creating Stderr: Network roottestreloadclustersconfig-gw7_default Created Stderr: Network roottestreloadclustersconfig-gw7_default Created Stderr: Container roottestreloadclustersconfig-gw7-zoo1-1 Creating Stderr: Container roottestreloadclustersconfig-gw7-zoo1-1 Creating Stderr: Container roottestreloadclustersconfig-gw7-zoo2-1 Creating Stderr: Container roottestreloadclustersconfig-gw7-zoo2-1 Creating Stderr: Container roottestreloadclustersconfig-gw7-zoo3-1 Creating Stderr: Container roottestreloadclustersconfig-gw7-zoo3-1 Creating Stderr: Container roottestreloadclustersconfig-gw7-zoo3-1 Created Stderr: Container roottestreloadclustersconfig-gw7-zoo3-1 Created Stderr: Container roottestreloadclustersconfig-gw7-zoo1-1 Created Stderr: Container roottestreloadclustersconfig-gw7-zoo1-1 Created Stderr: Container roottestreloadclustersconfig-gw7-zoo2-1 Created Stderr: Container roottestreloadclustersconfig-gw7-zoo2-1 Created Stderr: Container roottestreloadclustersconfig-gw7-zoo3-1 Starting Stderr: Container roottestreloadclustersconfig-gw7-zoo3-1 Starting Stderr: Container roottestreloadclustersconfig-gw7-zoo1-1 Starting Stderr: Container roottestreloadclustersconfig-gw7-zoo1-1 Starting Stderr: Container roottestreloadclustersconfig-gw7-zoo2-1 Starting Stderr: Container roottestreloadclustersconfig-gw7-zoo2-1 Starting Stderr: Container roottestreloadclustersconfig-gw7-zoo3-1 Started Stderr: Container roottestreloadclustersconfig-gw7-zoo3-1 Started Stderr: Container roottestreloadclustersconfig-gw7-zoo1-1 Started Stderr: Container roottestreloadclustersconfig-gw7-zoo1-1 Started Stderr: Container roottestreloadclustersconfig-gw7-zoo2-1 Started Stderr: Container roottestreloadclustersconfig-gw7-zoo2-1 Started Stderr:time="2025-04-02T02:52:48Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:52:48Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:52:48Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:52:48Z" level=debug msg="otel error" error="" Wait ZooKeeper to start Wait ZooKeeper to start get_instance_ip instance_name=zoo1 get_instance_ip instance_name=zoo1 http://localhost:None "GET /v1.46/containers/2da00efe3b92dbd74d75c5b4f1b1b6ba6bc9bcc037d843952c80b4f7f8737357/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2da00efe3b92dbd74d75c5b4f1b1b6ba6bc9bcc037d843952c80b4f7f8737357/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclustersconfig-gw7-zoo1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclustersconfig-gw7-zoo1-1/json HTTP/1.1" 200 None get_kazoo_client: zoo1, ip:172.16.3.4, port:2181, use_ssl:False get_kazoo_client: zoo1, ip:172.16.3.4, port:2181, use_ssl:False Connecting to 172.16.3.4(172.16.3.4):2181, use_ssl: False Connecting to 172.16.3.4(172.16.3.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.3.4(172.16.3.4):2181, use_ssl: False Connecting to 172.16.3.4(172.16.3.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/2da00efe3b92dbd74d75c5b4f1b1b6ba6bc9bcc037d843952c80b4f7f8737357/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2da00efe3b92dbd74d75c5b4f1b1b6ba6bc9bcc037d843952c80b4f7f8737357/json HTTP/1.1" 200 None Stderr:time="2025-04-02T02:52:46Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:52:46Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottestreloadclientcertificate-gw8_default Creating Stderr: Network roottestreloadclientcertificate-gw8_default Creating Stderr: Network roottestreloadclientcertificate-gw8_default Created Stderr: Network roottestreloadclientcertificate-gw8_default Created Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Creating Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Creating Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Creating Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Creating Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Creating Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Creating Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Created Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Created Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Created Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Created Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Created Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Created Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Starting Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Starting Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Starting Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Starting Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Starting Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Starting Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Started Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Started Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Started Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Started Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Started Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Started Stderr:time="2025-04-02T02:52:48Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:52:48Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:52:48Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:52:48Z" level=debug msg="otel error" error="" Wait ZooKeeper Secure to start Wait ZooKeeper Secure to start get_instance_ip instance_name=zoo1 get_instance_ip instance_name=zoo1 http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw8-zoo1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw8-zoo1-1/json HTTP/1.1" 200 None get_kazoo_client: zoo1, ip:172.16.4.3, port:2281, use_ssl:True get_kazoo_client: zoo1, ip:172.16.4.3, port:2281, use_ssl:True Connecting to 172.16.4.3(172.16.4.3):2281, use_ssl: True Connecting to 172.16.4.3(172.16.4.3):2281, use_ssl: True Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/2da00efe3b92dbd74d75c5b4f1b1b6ba6bc9bcc037d843952c80b4f7f8737357/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2da00efe3b92dbd74d75c5b4f1b1b6ba6bc9bcc037d843952c80b4f7f8737357/json HTTP/1.1" 200 None Connecting to 172.16.3.4(172.16.3.4):2181, use_ssl: False Connecting to 172.16.3.4(172.16.3.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.4.3(172.16.4.3):2281, use_ssl: True Connecting to 172.16.4.3(172.16.4.3):2281, use_ssl: True Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Stderr:time="2025-04-02T02:52:46Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:52:46Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottestpostgresqlreplicadatabaseengine1-gw1_default Creating Stderr: Network roottestpostgresqlreplicadatabaseengine1-gw1_default Creating Stderr: Network roottestpostgresqlreplicadatabaseengine1-gw1_default Created Stderr: Network roottestpostgresqlreplicadatabaseengine1-gw1_default Created Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw1-postgres1-1 Creating Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw1-postgres1-1 Creating Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw1-postgres1-1 Created Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw1-postgres1-1 Created Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw1-postgres1-1 Starting Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw1-postgres1-1 Starting Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw1-postgres1-1 Started Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw1-postgres1-1 Started Stderr:time="2025-04-02T02:52:48Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:52:48Z" level=debug msg="otel error" error="" http://localhost:None "GET /v1.46/containers/2da00efe3b92dbd74d75c5b4f1b1b6ba6bc9bcc037d843952c80b4f7f8737357/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2da00efe3b92dbd74d75c5b4f1b1b6ba6bc9bcc037d843952c80b4f7f8737357/json HTTP/1.1" 200 None Stderr:time="2025-04-02T02:52:48Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:52:48Z" level=debug msg="otel error" error="" get_instance_ip instance_name=postgres1 get_instance_ip instance_name=postgres1 http://localhost:None "GET /v1.46/containers/roottestpostgresqlreplicadatabaseengine1-gw1-postgres1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestpostgresqlreplicadatabaseengine1-gw1-postgres1-1/json HTTP/1.1" 200 None Can't connect to Postgres connection to server at "172.16.5.2", port 5432 failed: Connection refused Is the server running on that host and accepting TCP/IP connections? Can't connect to Postgres connection to server at "172.16.5.2", port 5432 failed: Connection refused Is the server running on that host and accepting TCP/IP connections? http://localhost:None "GET /v1.46/containers/2da00efe3b92dbd74d75c5b4f1b1b6ba6bc9bcc037d843952c80b4f7f8737357/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2da00efe3b92dbd74d75c5b4f1b1b6ba6bc9bcc037d843952c80b4f7f8737357/json HTTP/1.1" 200 None Connecting to 172.16.4.3(172.16.4.3):2281, use_ssl: True Connecting to 172.16.4.3(172.16.4.3):2281, use_ssl: True Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/2da00efe3b92dbd74d75c5b4f1b1b6ba6bc9bcc037d843952c80b4f7f8737357/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2da00efe3b92dbd74d75c5b4f1b1b6ba6bc9bcc037d843952c80b4f7f8737357/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2da00efe3b92dbd74d75c5b4f1b1b6ba6bc9bcc037d843952c80b4f7f8737357/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2da00efe3b92dbd74d75c5b4f1b1b6ba6bc9bcc037d843952c80b4f7f8737357/json HTTP/1.1" 200 None Connecting to 172.16.3.4(172.16.3.4):2181, use_ssl: False Connecting to 172.16.3.4(172.16.3.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Stderr:time="2025-04-02T02:52:46Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:52:46Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottestreplicatedmergetrees3zerocopy-gw5_default Creating Stderr: Network roottestreplicatedmergetrees3zerocopy-gw5_default Creating Stderr: Network roottestreplicatedmergetrees3zerocopy-gw5_default Created Stderr: Network roottestreplicatedmergetrees3zerocopy-gw5_default Created Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo1-1 Creating Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo1-1 Creating Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo2-1 Creating Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo2-1 Creating Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo3-1 Creating Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo3-1 Creating Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo3-1 Created Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo3-1 Created Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo2-1 Created Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo2-1 Created Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo1-1 Created Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo1-1 Created Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo3-1 Starting Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo3-1 Starting Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo1-1 Starting Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo1-1 Starting Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo2-1 Starting Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo2-1 Starting Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo1-1 Started Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo1-1 Started Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo2-1 Started Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo2-1 Started Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo3-1 Started Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo3-1 Started Stderr:time="2025-04-02T02:52:48Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:52:48Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:52:48Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:52:48Z" level=debug msg="otel error" error="" Wait ZooKeeper to start Wait ZooKeeper to start get_instance_ip instance_name=zoo1 get_instance_ip instance_name=zoo1 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw5-zoo1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw5-zoo1-1/json HTTP/1.1" 200 None get_kazoo_client: zoo1, ip:172.16.6.2, port:2181, use_ssl:False get_kazoo_client: zoo1, ip:172.16.6.2, port:2181, use_ssl:False http://localhost:None "GET /v1.46/containers/2da00efe3b92dbd74d75c5b4f1b1b6ba6bc9bcc037d843952c80b4f7f8737357/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2da00efe3b92dbd74d75c5b4f1b1b6ba6bc9bcc037d843952c80b4f7f8737357/json HTTP/1.1" 200 None Connecting to 172.16.6.2(172.16.6.2):2181, use_ssl: False Connecting to 172.16.6.2(172.16.6.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Can't connect to Postgres connection to server at "172.16.5.2", port 5432 failed: Connection refused Is the server running on that host and accepting TCP/IP connections? Can't connect to Postgres connection to server at "172.16.5.2", port 5432 failed: Connection refused Is the server running on that host and accepting TCP/IP connections? http://localhost:None "GET /v1.46/containers/2da00efe3b92dbd74d75c5b4f1b1b6ba6bc9bcc037d843952c80b4f7f8737357/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2da00efe3b92dbd74d75c5b4f1b1b6ba6bc9bcc037d843952c80b4f7f8737357/json HTTP/1.1" 200 None Connecting to 172.16.4.3(172.16.4.3):2281, use_ssl: True Connecting to 172.16.4.3(172.16.4.3):2281, use_ssl: True Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.6.2(172.16.6.2):2181, use_ssl: False Connecting to 172.16.6.2(172.16.6.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/2da00efe3b92dbd74d75c5b4f1b1b6ba6bc9bcc037d843952c80b4f7f8737357/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2da00efe3b92dbd74d75c5b4f1b1b6ba6bc9bcc037d843952c80b4f7f8737357/json HTTP/1.1" 200 None Connecting to 172.16.6.2(172.16.6.2):2181, use_ssl: False Connecting to 172.16.6.2(172.16.6.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/2da00efe3b92dbd74d75c5b4f1b1b6ba6bc9bcc037d843952c80b4f7f8737357/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2da00efe3b92dbd74d75c5b4f1b1b6ba6bc9bcc037d843952c80b4f7f8737357/json HTTP/1.1" 200 None ClickHouse node started ClickHouse node started run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/block_size/no_such_block_based_table_options/g' /etc/clickhouse-server/config.d/rocksdb.xml"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/block_size/no_such_block_based_table_options/g' /etc/clickhouse-server/config.d/rocksdb.xml"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c sed -i 's/block_size/no_such_block_based_table_options/g' /etc/clickhouse-server/config.d/rocksdb.xml] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c sed -i 's/block_size/no_such_block_based_table_options/g' /etc/clickhouse-server/config.d/rocksdb.xml] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c ps -C clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c ps -C clickhouse] Stdout: PID TTY TIME CMD Stdout: PID TTY TIME CMD Stdout: 8 ? 00:00:01 clickhouse Stdout: 8 ? 00:00:01 clickhouse run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c pkill clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c pkill clickhouse] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:8 Stdout:8 Stderr:time="2025-04-02T02:52:47Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:52:47Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottestscheduler-gw3_default Creating Stderr: Network roottestscheduler-gw3_default Creating Stderr: Network roottestscheduler-gw3_default Created Stderr: Network roottestscheduler-gw3_default Created Stderr: Container roottestscheduler-gw3-zoo1-1 Creating Stderr: Container roottestscheduler-gw3-zoo1-1 Creating Stderr: Container roottestscheduler-gw3-zoo2-1 Creating Stderr: Container roottestscheduler-gw3-zoo2-1 Creating Stderr: Container roottestscheduler-gw3-zoo3-1 Creating Stderr: Container roottestscheduler-gw3-zoo3-1 Creating Stderr: Container roottestscheduler-gw3-zoo1-1 Created Stderr: Container roottestscheduler-gw3-zoo1-1 Created Stderr: Container roottestscheduler-gw3-zoo2-1 Created Stderr: Container roottestscheduler-gw3-zoo2-1 Created Stderr: Container roottestscheduler-gw3-zoo3-1 Created Stderr: Container roottestscheduler-gw3-zoo3-1 Created Stderr: Container roottestscheduler-gw3-zoo3-1 Starting Stderr: Container roottestscheduler-gw3-zoo3-1 Starting Stderr: Container roottestscheduler-gw3-zoo1-1 Starting Stderr: Container roottestscheduler-gw3-zoo1-1 Starting Stderr: Container roottestscheduler-gw3-zoo2-1 Starting Stderr: Container roottestscheduler-gw3-zoo2-1 Starting Stderr: Container roottestscheduler-gw3-zoo2-1 Started Stderr: Container roottestscheduler-gw3-zoo2-1 Started Stderr: Container roottestscheduler-gw3-zoo3-1 Started Stderr: Container roottestscheduler-gw3-zoo3-1 Started Stderr: Container roottestscheduler-gw3-zoo1-1 Started Stderr: Container roottestscheduler-gw3-zoo1-1 Started Stderr:time="2025-04-02T02:52:49Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:52:49Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:52:49Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:52:49Z" level=debug msg="otel error" error="" Wait ZooKeeper to start Wait ZooKeeper to start get_instance_ip instance_name=zoo1 get_instance_ip instance_name=zoo1 http://localhost:None "GET /v1.46/containers/roottestscheduler-gw3-zoo1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestscheduler-gw3-zoo1-1/json HTTP/1.1" 200 None get_kazoo_client: zoo1, ip:172.16.8.4, port:2181, use_ssl:False get_kazoo_client: zoo1, ip:172.16.8.4, port:2181, use_ssl:False Connecting to 172.16.8.4(172.16.8.4):2181, use_ssl: False Connecting to 172.16.8.4(172.16.8.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.6.2(172.16.6.2):2181, use_ssl: False Connecting to 172.16.6.2(172.16.6.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Can't connect to Postgres connection to server at "172.16.5.2", port 5432 failed: Connection refused Is the server running on that host and accepting TCP/IP connections? Can't connect to Postgres connection to server at "172.16.5.2", port 5432 failed: Connection refused Is the server running on that host and accepting TCP/IP connections? Connecting to 172.16.8.4(172.16.8.4):2181, use_ssl: False Connecting to 172.16.8.4(172.16.8.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Stderr:time="2025-04-02T02:52:47Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:52:47Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottestreplicateduserdefinedfunctions-gw2_default Creating Stderr: Network roottestreplicateduserdefinedfunctions-gw2_default Creating Stderr: Network roottestreplicateduserdefinedfunctions-gw2_default Created Stderr: Network roottestreplicateduserdefinedfunctions-gw2_default Created Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Creating Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Creating Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Creating Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Creating Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Creating Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Creating Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Created Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Created Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Created Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Created Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Created Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Created Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Starting Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Starting Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Starting Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Starting Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Starting Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Starting Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Started Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Started Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Started Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Started Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Started Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Started Stderr:time="2025-04-02T02:52:49Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:52:49Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:52:49Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:52:49Z" level=debug msg="otel error" error="" Wait ZooKeeper to start Wait ZooKeeper to start get_instance_ip instance_name=zoo1 get_instance_ip instance_name=zoo1 http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-zoo1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-zoo1-1/json HTTP/1.1" 200 None get_kazoo_client: zoo1, ip:172.16.9.2, port:2181, use_ssl:False get_kazoo_client: zoo1, ip:172.16.9.2, port:2181, use_ssl:False Connecting to 172.16.8.4(172.16.8.4):2181, use_ssl: False Connecting to 172.16.8.4(172.16.8.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.4.3(172.16.4.3):2281, use_ssl: True Connecting to 172.16.4.3(172.16.4.3):2281, use_ssl: True Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.3.4(172.16.3.4):2181, use_ssl: False Connecting to 172.16.3.4(172.16.3.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.8.4(172.16.8.4):2181, use_ssl: False Connecting to 172.16.8.4(172.16.8.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.6.2(172.16.6.2):2181, use_ssl: False Connecting to 172.16.6.2(172.16.6.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Stderr:time="2025-04-02T02:52:47Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:52:47Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottests3lowcardinalityrightborder-gw9_default Creating Stderr: Network roottests3lowcardinalityrightborder-gw9_default Creating Stderr: Network roottests3lowcardinalityrightborder-gw9_default Created Stderr: Network roottests3lowcardinalityrightborder-gw9_default Created Stderr: Volume "roottests3lowcardinalityrightborder-gw9_data1-1" Creating Stderr: Volume "roottests3lowcardinalityrightborder-gw9_data1-1" Creating Stderr: Volume "roottests3lowcardinalityrightborder-gw9_data1-1" Created Stderr: Volume "roottests3lowcardinalityrightborder-gw9_data1-1" Created Stderr: Container roottests3lowcardinalityrightborder-gw9-proxy2-1 Creating Stderr: Container roottests3lowcardinalityrightborder-gw9-proxy2-1 Creating Stderr: Container roottests3lowcardinalityrightborder-gw9-proxy1-1 Creating Stderr: Container roottests3lowcardinalityrightborder-gw9-proxy1-1 Creating Stderr: Container roottests3lowcardinalityrightborder-gw9-proxy2-1 Created Stderr: Container roottests3lowcardinalityrightborder-gw9-proxy2-1 Created Stderr: Container roottests3lowcardinalityrightborder-gw9-proxy1-1 Created Stderr: Container roottests3lowcardinalityrightborder-gw9-proxy1-1 Created Stderr: Container roottests3lowcardinalityrightborder-gw9-minio1-1 Creating Stderr: Container roottests3lowcardinalityrightborder-gw9-minio1-1 Creating Stderr: Container roottests3lowcardinalityrightborder-gw9-resolver-1 Creating Stderr: Container roottests3lowcardinalityrightborder-gw9-resolver-1 Creating Stderr: Container roottests3lowcardinalityrightborder-gw9-minio1-1 Created Stderr: Container roottests3lowcardinalityrightborder-gw9-minio1-1 Created Stderr: Container roottests3lowcardinalityrightborder-gw9-resolver-1 Created Stderr: Container roottests3lowcardinalityrightborder-gw9-resolver-1 Created Stderr: Container roottests3lowcardinalityrightborder-gw9-proxy2-1 Starting Stderr: Container roottests3lowcardinalityrightborder-gw9-proxy2-1 Starting Stderr: Container roottests3lowcardinalityrightborder-gw9-proxy1-1 Starting Stderr: Container roottests3lowcardinalityrightborder-gw9-proxy1-1 Starting Stderr: Container roottests3lowcardinalityrightborder-gw9-proxy2-1 Started Stderr: Container roottests3lowcardinalityrightborder-gw9-proxy2-1 Started Stderr: Container roottests3lowcardinalityrightborder-gw9-proxy1-1 Started Stderr: Container roottests3lowcardinalityrightborder-gw9-proxy1-1 Started Stderr: Container roottests3lowcardinalityrightborder-gw9-minio1-1 Starting Stderr: Container roottests3lowcardinalityrightborder-gw9-minio1-1 Starting Stderr: Container roottests3lowcardinalityrightborder-gw9-resolver-1 Starting Stderr: Container roottests3lowcardinalityrightborder-gw9-resolver-1 Starting Stderr: Container roottests3lowcardinalityrightborder-gw9-minio1-1 Started Stderr: Container roottests3lowcardinalityrightborder-gw9-minio1-1 Started Stderr: Container roottests3lowcardinalityrightborder-gw9-resolver-1 Started Stderr: Container roottests3lowcardinalityrightborder-gw9-resolver-1 Started Stderr:time="2025-04-02T02:52:49Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:52:49Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:52:49Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:52:49Z" level=debug msg="otel error" error="" Trying to connect to Minio... Trying to connect to Minio... get_instance_ip instance_name=minio1 get_instance_ip instance_name=minio1 http://localhost:None "GET /v1.46/containers/roottests3lowcardinalityrightborder-gw9-minio1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3lowcardinalityrightborder-gw9-minio1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=proxy1 get_instance_ip instance_name=proxy1 http://localhost:None "GET /v1.46/containers/roottests3lowcardinalityrightborder-gw9-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3lowcardinalityrightborder-gw9-proxy1-1/json HTTP/1.1" 200 None Starting new HTTP connection (1): 172.16.7.4:9001 Starting new HTTP connection (1): 172.16.7.4:9001 Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (2): 172.16.7.4:9001 Starting new HTTP connection (2): 172.16.7.4:9001 Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (3): 172.16.7.4:9001 Starting new HTTP connection (3): 172.16.7.4:9001 Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (4): 172.16.7.4:9001 Starting new HTTP connection (4): 172.16.7.4:9001 Can't connect to Minio: HTTPConnectionPool(host='172.16.7.4', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Can't connect to Minio: HTTPConnectionPool(host='172.16.7.4', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Postgres Started Postgres Started ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw1/.env --project-name roottestpostgresqlreplicadatabaseengine1-gw1 --file /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw1/instance/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_postgres.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw1/.env --project-name roottestpostgresqlreplicadatabaseengine1-gw1 --file /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw1/instance/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_postgres.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw1/.env --project-name roottestpostgresqlreplicadatabaseengine1-gw1 --file /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw1/instance/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_postgres.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw1/.env --project-name roottestpostgresqlreplicadatabaseengine1-gw1 --file /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw1/instance/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_postgres.yml up -d --no-recreate] Connecting to 172.16.8.4(172.16.8.4):2181, use_ssl: False Connecting to 172.16.8.4(172.16.8.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Stderr:time="2025-04-02T02:52:47Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:52:47Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottests3tablefunctionwithhttpproxy-gw6_default Creating Stderr: Network roottests3tablefunctionwithhttpproxy-gw6_default Creating Stderr: Network roottests3tablefunctionwithhttpproxy-gw6_default Created Stderr: Network roottests3tablefunctionwithhttpproxy-gw6_default Created Stderr: Volume "roottests3tablefunctionwithhttpproxy-gw6_data1-1" Creating Stderr: Volume "roottests3tablefunctionwithhttpproxy-gw6_data1-1" Creating Stderr: Volume "roottests3tablefunctionwithhttpproxy-gw6_data1-1" Created Stderr: Volume "roottests3tablefunctionwithhttpproxy-gw6_data1-1" Created Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy2-1 Creating Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy2-1 Creating Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy1-1 Creating Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy1-1 Creating Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy2-1 Created Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy2-1 Created Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy1-1 Created Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy1-1 Created Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-resolver-1 Creating Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-resolver-1 Creating Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-minio1-1 Creating Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-minio1-1 Creating Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-resolver-1 Created Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-resolver-1 Created Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-minio1-1 Created Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-minio1-1 Created Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy2-1 Starting Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy2-1 Starting Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy1-1 Starting Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy1-1 Starting Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy1-1 Started Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy1-1 Started Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy2-1 Started Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy2-1 Started Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-minio1-1 Starting Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-minio1-1 Starting Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-resolver-1 Starting Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-resolver-1 Starting Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-resolver-1 Started Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-resolver-1 Started Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-minio1-1 Started Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-minio1-1 Started Stderr:time="2025-04-02T02:52:50Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:52:50Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:52:50Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:52:50Z" level=debug msg="otel error" error="" Trying to connect to Minio... Trying to connect to Minio... get_instance_ip instance_name=minio1 get_instance_ip instance_name=minio1 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-minio1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-minio1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=proxy1 get_instance_ip instance_name=proxy1 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None Starting new HTTP connection (1): 172.16.10.5:9001 Starting new HTTP connection (1): 172.16.10.5:9001 Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (2): 172.16.10.5:9001 Starting new HTTP connection (2): 172.16.10.5:9001 Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (3): 172.16.10.5:9001 Starting new HTTP connection (3): 172.16.10.5:9001 Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (4): 172.16.10.5:9001 Starting new HTTP connection (4): 172.16.10.5:9001 Can't connect to Minio: HTTPConnectionPool(host='172.16.10.5', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Can't connect to Minio: HTTPConnectionPool(host='172.16.10.5', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 Creating Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 Creating Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw1-postgres1-1 Running Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw1-postgres1-1 Running Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 Created Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 Created Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 Starting Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 Starting Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 Started Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=instance get_instance_ip instance_name=instance http://localhost:None "GET /v1.46/containers/roottestpostgresqlreplicadatabaseengine1-gw1-instance-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestpostgresqlreplicadatabaseengine1-gw1-instance-1/json HTTP/1.1" 200 None get_instance_ip instance_name=instance get_instance_ip instance_name=instance http://localhost:None "GET /v1.46/containers/roottestpostgresqlreplicadatabaseengine1-gw1-instance-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestpostgresqlreplicadatabaseengine1-gw1-instance-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in instance, ip: 172.16.5.3... Waiting for ClickHouse start in instance, ip: 172.16.5.3... http://localhost:None "GET /v1.46/containers/roottestpostgresqlreplicadatabaseengine1-gw1-instance-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestpostgresqlreplicadatabaseengine1-gw1-instance-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f94d3ec8766b9c6d6faeb82c8eb5ecc379bf45076b9c6e043c87e6af9fb33782/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f94d3ec8766b9c6d6faeb82c8eb5ecc379bf45076b9c6e043c87e6af9fb33782/json HTTP/1.1" 200 None Stdout:8 Stdout:8 http://localhost:None "GET /v1.46/containers/f94d3ec8766b9c6d6faeb82c8eb5ecc379bf45076b9c6e043c87e6af9fb33782/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f94d3ec8766b9c6d6faeb82c8eb5ecc379bf45076b9c6e043c87e6af9fb33782/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f94d3ec8766b9c6d6faeb82c8eb5ecc379bf45076b9c6e043c87e6af9fb33782/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f94d3ec8766b9c6d6faeb82c8eb5ecc379bf45076b9c6e043c87e6af9fb33782/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f94d3ec8766b9c6d6faeb82c8eb5ecc379bf45076b9c6e043c87e6af9fb33782/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f94d3ec8766b9c6d6faeb82c8eb5ecc379bf45076b9c6e043c87e6af9fb33782/json HTTP/1.1" 200 None Connecting to 172.16.8.4(172.16.8.4):2181, use_ssl: False Connecting to 172.16.8.4(172.16.8.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/f94d3ec8766b9c6d6faeb82c8eb5ecc379bf45076b9c6e043c87e6af9fb33782/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f94d3ec8766b9c6d6faeb82c8eb5ecc379bf45076b9c6e043c87e6af9fb33782/json HTTP/1.1" 200 None Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.6.2(172.16.6.2):2181, use_ssl: False Connecting to 172.16.6.2(172.16.6.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/f94d3ec8766b9c6d6faeb82c8eb5ecc379bf45076b9c6e043c87e6af9fb33782/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f94d3ec8766b9c6d6faeb82c8eb5ecc379bf45076b9c6e043c87e6af9fb33782/json HTTP/1.1" 200 None Starting new HTTP connection (5): 172.16.7.4:9001 Starting new HTTP connection (5): 172.16.7.4:9001 http://172.16.7.4:9001 "GET / HTTP/1.1" 200 0 http://172.16.7.4:9001 "GET / HTTP/1.1" 200 0 Connected to Minio. Connected to Minio. http://172.16.7.4:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.7.4:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.7.4:9001 "PUT /root HTTP/1.1" 200 0 http://172.16.7.4:9001 "PUT /root HTTP/1.1" 200 0 S3 bucket 'root' created S3 bucket 'root' created http://172.16.7.4:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.7.4:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.7.4:9001 "PUT /root2 HTTP/1.1" 200 0 http://172.16.7.4:9001 "PUT /root2 HTTP/1.1" 200 0 S3 bucket 'root2' created S3 bucket 'root2' created ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw9/.env --project-name roottests3lowcardinalityrightborder-gw9 --file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw9/.env --project-name roottests3lowcardinalityrightborder-gw9 --file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw9/.env --project-name roottests3lowcardinalityrightborder-gw9 --file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw9/.env --project-name roottests3lowcardinalityrightborder-gw9 --file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate] Connecting to 172.16.3.4(172.16.3.4):2181, use_ssl: False Connecting to 172.16.3.4(172.16.3.4):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost http://localhost:None "GET /v1.46/containers/f94d3ec8766b9c6d6faeb82c8eb5ecc379bf45076b9c6e043c87e6af9fb33782/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f94d3ec8766b9c6d6faeb82c8eb5ecc379bf45076b9c6e043c87e6af9fb33782/json HTTP/1.1" 200 None Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo2 get_instance_ip instance_name=zoo2 Connecting to 172.16.4.3(172.16.4.3):2281, use_ssl: True Connecting to 172.16.4.3(172.16.4.3):2281, use_ssl: True http://localhost:None "GET /v1.46/containers/roottestreloadclustersconfig-gw7-zoo2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclustersconfig-gw7-zoo2-1/json HTTP/1.1" 200 None get_kazoo_client: zoo2, ip:172.16.3.3, port:2181, use_ssl:False get_kazoo_client: zoo2, ip:172.16.3.3, port:2181, use_ssl:False Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost http://localhost:None "GET /v1.46/containers/f94d3ec8766b9c6d6faeb82c8eb5ecc379bf45076b9c6e043c87e6af9fb33782/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f94d3ec8766b9c6d6faeb82c8eb5ecc379bf45076b9c6e043c87e6af9fb33782/json HTTP/1.1" 200 None Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo3 get_instance_ip instance_name=zoo3 http://localhost:None "GET /v1.46/containers/roottestreloadclustersconfig-gw7-zoo3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclustersconfig-gw7-zoo3-1/json HTTP/1.1" 200 None get_kazoo_client: zoo3, ip:172.16.3.2, port:2181, use_ssl:False get_kazoo_client: zoo3, ip:172.16.3.2, port:2181, use_ssl:False Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost http://localhost:None "GET /v1.46/containers/f94d3ec8766b9c6d6faeb82c8eb5ecc379bf45076b9c6e043c87e6af9fb33782/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f94d3ec8766b9c6d6faeb82c8eb5ecc379bf45076b9c6e043c87e6af9fb33782/json HTTP/1.1" 200 None Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/.env --project-name roottestreloadclustersconfig-gw7 --file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/.env --project-name roottestreloadclustersconfig-gw7 --file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/.env --project-name roottestreloadclustersconfig-gw7 --file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/.env --project-name roottestreloadclustersconfig-gw7 --file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml up -d --no-recreate] Starting new HTTP connection (5): 172.16.10.5:9001 Starting new HTTP connection (5): 172.16.10.5:9001 http://172.16.10.5:9001 "GET / HTTP/1.1" 200 0 http://172.16.10.5:9001 "GET / HTTP/1.1" 200 0 Connected to Minio. Connected to Minio. http://172.16.10.5:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.10.5:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.10.5:9001 "PUT /root HTTP/1.1" 200 0 http://172.16.10.5:9001 "PUT /root HTTP/1.1" 200 0 S3 bucket 'root' created S3 bucket 'root' created http://172.16.10.5:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.10.5:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.10.5:9001 "PUT /root2 HTTP/1.1" 200 0 http://172.16.10.5:9001 "PUT /root2 HTTP/1.1" 200 0 S3 bucket 'root2' created S3 bucket 'root2' created ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/.env --project-name roottests3tablefunctionwithhttpproxy-gw6 --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node_no_proxy/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node_no_proxy/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node_no_proxy/docker-compose.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/.env --project-name roottests3tablefunctionwithhttpproxy-gw6 --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node_no_proxy/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node_no_proxy/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node_no_proxy/docker-compose.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/.env --project-name roottests3tablefunctionwithhttpproxy-gw6 --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node_no_proxy/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node_no_proxy/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node_no_proxy/docker-compose.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/.env --project-name roottests3tablefunctionwithhttpproxy-gw6 --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node_no_proxy/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node_no_proxy/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node_no_proxy/docker-compose.yml up -d --no-recreate] http://localhost:None "GET /v1.46/containers/f94d3ec8766b9c6d6faeb82c8eb5ecc379bf45076b9c6e043c87e6af9fb33782/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f94d3ec8766b9c6d6faeb82c8eb5ecc379bf45076b9c6e043c87e6af9fb33782/json HTTP/1.1" 200 None Stderr: Container roottests3lowcardinalityrightborder-gw9-proxy1-1 Running Stderr: Container roottests3lowcardinalityrightborder-gw9-proxy1-1 Running Stderr: Container roottests3lowcardinalityrightborder-gw9-proxy2-1 Running Stderr: Container roottests3lowcardinalityrightborder-gw9-proxy2-1 Running Stderr: Container roottests3lowcardinalityrightborder-gw9-minio1-1 Running Stderr: Container roottests3lowcardinalityrightborder-gw9-minio1-1 Running Stderr: Container roottests3lowcardinalityrightborder-gw9-resolver-1 Running Stderr: Container roottests3lowcardinalityrightborder-gw9-resolver-1 Running Stderr: Container roottests3lowcardinalityrightborder-gw9-node1-1 Creating Stderr: Container roottests3lowcardinalityrightborder-gw9-node1-1 Creating Stderr: Container roottests3lowcardinalityrightborder-gw9-node1-1 Created Stderr: Container roottests3lowcardinalityrightborder-gw9-node1-1 Created Stderr: Container roottests3lowcardinalityrightborder-gw9-node1-1 Starting Stderr: Container roottests3lowcardinalityrightborder-gw9-node1-1 Starting Stderr: Container roottests3lowcardinalityrightborder-gw9-node1-1 Started Stderr: Container roottests3lowcardinalityrightborder-gw9-node1-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node1 get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottests3lowcardinalityrightborder-gw9-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3lowcardinalityrightborder-gw9-node1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node1 get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottests3lowcardinalityrightborder-gw9-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3lowcardinalityrightborder-gw9-node1-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node1, ip: 172.16.7.6... Waiting for ClickHouse start in node1, ip: 172.16.7.6... http://localhost:None "GET /v1.46/containers/roottests3lowcardinalityrightborder-gw9-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3lowcardinalityrightborder-gw9-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4d6a91373b8d5d89a7296847301134abbe4e2419a4e6dfeba0231c8fb6ffc551/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4d6a91373b8d5d89a7296847301134abbe4e2419a4e6dfeba0231c8fb6ffc551/json HTTP/1.1" 200 None run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] http://localhost:None "GET /v1.46/containers/f94d3ec8766b9c6d6faeb82c8eb5ecc379bf45076b9c6e043c87e6af9fb33782/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f94d3ec8766b9c6d6faeb82c8eb5ecc379bf45076b9c6e043c87e6af9fb33782/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4d6a91373b8d5d89a7296847301134abbe4e2419a4e6dfeba0231c8fb6ffc551/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4d6a91373b8d5d89a7296847301134abbe4e2419a4e6dfeba0231c8fb6ffc551/json HTTP/1.1" 200 None Stdout:8 Stdout:8 http://localhost:None "GET /v1.46/containers/f94d3ec8766b9c6d6faeb82c8eb5ecc379bf45076b9c6e043c87e6af9fb33782/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f94d3ec8766b9c6d6faeb82c8eb5ecc379bf45076b9c6e043c87e6af9fb33782/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4d6a91373b8d5d89a7296847301134abbe4e2419a4e6dfeba0231c8fb6ffc551/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4d6a91373b8d5d89a7296847301134abbe4e2419a4e6dfeba0231c8fb6ffc551/json HTTP/1.1" 200 None Stderr: Container roottestreloadclustersconfig-gw7-zoo1-1 Running Stderr: Container roottestreloadclustersconfig-gw7-zoo1-1 Running Stderr: Container roottestreloadclustersconfig-gw7-zoo2-1 Running Stderr: Container roottestreloadclustersconfig-gw7-zoo2-1 Running Stderr: Container roottestreloadclustersconfig-gw7-zoo3-1 Running Stderr: Container roottestreloadclustersconfig-gw7-zoo3-1 Running Stderr: Container roottestreloadclustersconfig-gw7-node-1 Creating Stderr: Container roottestreloadclustersconfig-gw7-node-1 Creating Stderr: Container roottestreloadclustersconfig-gw7-node-1 Created Stderr: Container roottestreloadclustersconfig-gw7-node-1 Created Stderr: Container roottestreloadclustersconfig-gw7-node-1 Starting Stderr: Container roottestreloadclustersconfig-gw7-node-1 Starting Stderr: Container roottestreloadclustersconfig-gw7-node-1 Started Stderr: Container roottestreloadclustersconfig-gw7-node-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottestreloadclustersconfig-gw7-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclustersconfig-gw7-node-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottestreloadclustersconfig-gw7-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclustersconfig-gw7-node-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node, ip: 172.16.3.5... Waiting for ClickHouse start in node, ip: 172.16.3.5... http://localhost:None "GET /v1.46/containers/roottestreloadclustersconfig-gw7-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclustersconfig-gw7-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f94d3ec8766b9c6d6faeb82c8eb5ecc379bf45076b9c6e043c87e6af9fb33782/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f94d3ec8766b9c6d6faeb82c8eb5ecc379bf45076b9c6e043c87e6af9fb33782/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4d6a91373b8d5d89a7296847301134abbe4e2419a4e6dfeba0231c8fb6ffc551/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4d6a91373b8d5d89a7296847301134abbe4e2419a4e6dfeba0231c8fb6ffc551/json HTTP/1.1" 200 None Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['zookeeper'] Received response(xid=1): ['zookeeper'] Sending request(xid=2): Close() Connecting to 172.16.8.4(172.16.8.4):2181, use_ssl: False Connecting to 172.16.8.4(172.16.8.4):2181, use_ssl: False Sending request(xid=2): Close() Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Closing connection to 172.16.4.3:2281 Closing connection to 172.16.4.3:2281 Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo2 get_instance_ip instance_name=zoo2 http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw8-zoo2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw8-zoo2-1/json HTTP/1.1" 200 None get_kazoo_client: zoo2, ip:172.16.4.2, port:2281, use_ssl:True get_kazoo_client: zoo2, ip:172.16.4.2, port:2281, use_ssl:True Connecting to 172.16.4.2(172.16.4.2):2281, use_ssl: True Connecting to 172.16.4.2(172.16.4.2):2281, use_ssl: True http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f94d3ec8766b9c6d6faeb82c8eb5ecc379bf45076b9c6e043c87e6af9fb33782/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f94d3ec8766b9c6d6faeb82c8eb5ecc379bf45076b9c6e043c87e6af9fb33782/json HTTP/1.1" 200 None ClickHouse instance started ClickHouse instance started http://localhost:None "GET /v1.46/containers/4d6a91373b8d5d89a7296847301134abbe4e2419a4e6dfeba0231c8fb6ffc551/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4d6a91373b8d5d89a7296847301134abbe4e2419a4e6dfeba0231c8fb6ffc551/json HTTP/1.1" 200 None Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4d6a91373b8d5d89a7296847301134abbe4e2419a4e6dfeba0231c8fb6ffc551/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4d6a91373b8d5d89a7296847301134abbe4e2419a4e6dfeba0231c8fb6ffc551/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4d6a91373b8d5d89a7296847301134abbe4e2419a4e6dfeba0231c8fb6ffc551/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4d6a91373b8d5d89a7296847301134abbe4e2419a4e6dfeba0231c8fb6ffc551/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4d6a91373b8d5d89a7296847301134abbe4e2419a4e6dfeba0231c8fb6ffc551/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4d6a91373b8d5d89a7296847301134abbe4e2419a4e6dfeba0231c8fb6ffc551/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4d6a91373b8d5d89a7296847301134abbe4e2419a4e6dfeba0231c8fb6ffc551/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4d6a91373b8d5d89a7296847301134abbe4e2419a4e6dfeba0231c8fb6ffc551/json HTTP/1.1" 200 None Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy2-1 Running Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy2-1 Running Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy1-1 Running Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy1-1 Running Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-minio1-1 Running Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-minio1-1 Running Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node-1 Creating Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node-1 Creating Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-resolver-1 Running Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-resolver-1 Running Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node-1 Creating Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node-1 Creating Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-env_node_no_proxy-1 Creating Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-env_node_no_proxy-1 Creating Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-env_node-1 Creating Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-env_node-1 Creating Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node_no_proxy-1 Creating Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node_no_proxy-1 Creating Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node_no_proxy-1 Creating Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node_no_proxy-1 Creating Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-env_node_no_proxy-1 Created Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-env_node_no_proxy-1 Created Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node-1 Created Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node-1 Created Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node_no_proxy-1 Created Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node_no_proxy-1 Created Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node_no_proxy-1 Created Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node_no_proxy-1 Created Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-env_node-1 Created Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-env_node-1 Created Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node-1 Created Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node-1 Created Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node_no_proxy-1 Starting Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node_no_proxy-1 Starting Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node_no_proxy-1 Starting Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node_no_proxy-1 Starting Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-env_node-1 Starting Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-env_node-1 Starting Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-env_node_no_proxy-1 Starting Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-env_node_no_proxy-1 Starting Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node-1 Starting Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node-1 Starting Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node-1 Starting Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node-1 Starting Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-env_node-1 Started Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-env_node-1 Started Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-env_node_no_proxy-1 Started Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-env_node_no_proxy-1 Started Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node-1 Started Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node-1 Started Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node-1 Started Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node-1 Started Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node_no_proxy-1 Started Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node_no_proxy-1 Started Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node_no_proxy-1 Started Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node_no_proxy-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=remote_proxy_node get_instance_ip instance_name=remote_proxy_node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node-1/json HTTP/1.1" 200 None get_instance_ip instance_name=remote_proxy_node get_instance_ip instance_name=remote_proxy_node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in remote_proxy_node, ip: 172.16.10.8... Waiting for ClickHouse start in remote_proxy_node, ip: 172.16.10.8... http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node-1/json HTTP/1.1" 200 None Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) http://localhost:None "GET /v1.46/containers/dbda782b00998c3da431c550350bacc2a76b6eaf5a4feef76df3edcc119658a3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/dbda782b00998c3da431c550350bacc2a76b6eaf5a4feef76df3edcc119658a3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['zookeeper'] Received response(xid=1): ['zookeeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Closing connection to 172.16.4.2:2281 Closing connection to 172.16.4.2:2281 Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo3 get_instance_ip instance_name=zoo3 http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw8-zoo3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw8-zoo3-1/json HTTP/1.1" 200 None get_kazoo_client: zoo3, ip:172.16.4.4, port:2281, use_ssl:True get_kazoo_client: zoo3, ip:172.16.4.4, port:2281, use_ssl:True Connecting to 172.16.4.4(172.16.4.4):2281, use_ssl: True Connecting to 172.16.4.4(172.16.4.4):2281, use_ssl: True Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance http://localhost:None "GET /v1.46/containers/4d6a91373b8d5d89a7296847301134abbe4e2419a4e6dfeba0231c8fb6ffc551/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4d6a91373b8d5d89a7296847301134abbe4e2419a4e6dfeba0231c8fb6ffc551/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/dbda782b00998c3da431c550350bacc2a76b6eaf5a4feef76df3edcc119658a3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/dbda782b00998c3da431c550350bacc2a76b6eaf5a4feef76df3edcc119658a3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4d6a91373b8d5d89a7296847301134abbe4e2419a4e6dfeba0231c8fb6ffc551/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4d6a91373b8d5d89a7296847301134abbe4e2419a4e6dfeba0231c8fb6ffc551/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/dbda782b00998c3da431c550350bacc2a76b6eaf5a4feef76df3edcc119658a3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/dbda782b00998c3da431c550350bacc2a76b6eaf5a4feef76df3edcc119658a3/json HTTP/1.1" 200 None Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query DROP DATABASE IF EXISTS `test_database` on instance Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] http://localhost:None "GET /v1.46/containers/4d6a91373b8d5d89a7296847301134abbe4e2419a4e6dfeba0231c8fb6ffc551/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4d6a91373b8d5d89a7296847301134abbe4e2419a4e6dfeba0231c8fb6ffc551/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/dbda782b00998c3da431c550350bacc2a76b6eaf5a4feef76df3edcc119658a3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/dbda782b00998c3da431c550350bacc2a76b6eaf5a4feef76df3edcc119658a3/json HTTP/1.1" 200 None Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo2 get_instance_ip instance_name=zoo2 http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw0-zoo2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw0-zoo2-1/json HTTP/1.1" 200 None get_kazoo_client: zoo2, ip:172.16.1.2, port:2181, use_ssl:False get_kazoo_client: zoo2, ip:172.16.1.2, port:2181, use_ssl:False Connecting to 172.16.1.2(172.16.1.2):2181, use_ssl: False Connecting to 172.16.1.2(172.16.1.2):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost http://localhost:None "GET /v1.46/containers/4d6a91373b8d5d89a7296847301134abbe4e2419a4e6dfeba0231c8fb6ffc551/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4d6a91373b8d5d89a7296847301134abbe4e2419a4e6dfeba0231c8fb6ffc551/json HTTP/1.1" 200 None No clickhouse process running. Start new one. No clickhouse process running. Start new one. http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw4-node-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw4-node-1/exec HTTP/1.1" 201 74 http://localhost:None "GET /v1.46/containers/dbda782b00998c3da431c550350bacc2a76b6eaf5a4feef76df3edcc119658a3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/dbda782b00998c3da431c550350bacc2a76b6eaf5a4feef76df3edcc119658a3/json HTTP/1.1" 200 None Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "POST /v1.46/exec/4a8297338c3949d4dd1fa23a920482080488ecdea60cf0bad71fe286839b4c71/start HTTP/1.1" 200 0 http://localhost:None "POST /v1.46/exec/4a8297338c3949d4dd1fa23a920482080488ecdea60cf0bad71fe286839b4c71/start HTTP/1.1" 200 0 http://localhost:None "GET /v1.46/exec/4a8297338c3949d4dd1fa23a920482080488ecdea60cf0bad71fe286839b4c71/json HTTP/1.1" 200 586 http://localhost:None "GET /v1.46/exec/4a8297338c3949d4dd1fa23a920482080488ecdea60cf0bad71fe286839b4c71/json HTTP/1.1" 200 586 Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo3 get_instance_ip instance_name=zoo3 http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw0-zoo3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw0-zoo3-1/json HTTP/1.1" 200 None get_kazoo_client: zoo3, ip:172.16.1.3, port:2181, use_ssl:False get_kazoo_client: zoo3, ip:172.16.1.3, port:2181, use_ssl:False Connecting to 172.16.1.3(172.16.1.3):2181, use_ssl: False Connecting to 172.16.1.3(172.16.1.3):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost http://localhost:None "GET /v1.46/containers/4d6a91373b8d5d89a7296847301134abbe4e2419a4e6dfeba0231c8fb6ffc551/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4d6a91373b8d5d89a7296847301134abbe4e2419a4e6dfeba0231c8fb6ffc551/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/dbda782b00998c3da431c550350bacc2a76b6eaf5a4feef76df3edcc119658a3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/dbda782b00998c3da431c550350bacc2a76b6eaf5a4feef76df3edcc119658a3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/.env --project-name roottestrenamecolumn-gw0 --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node3/docker-compose.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node4/docker-compose.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/.env --project-name roottestrenamecolumn-gw0 --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node3/docker-compose.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node4/docker-compose.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/.env --project-name roottestrenamecolumn-gw0 --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node3/docker-compose.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node4/docker-compose.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/.env --project-name roottestrenamecolumn-gw0 --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node3/docker-compose.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node4/docker-compose.yml up -d --no-recreate] http://localhost:None "GET /v1.46/containers/4d6a91373b8d5d89a7296847301134abbe4e2419a4e6dfeba0231c8fb6ffc551/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4d6a91373b8d5d89a7296847301134abbe4e2419a4e6dfeba0231c8fb6ffc551/json HTTP/1.1" 200 None Executing query SHOW DATABASES on instance Executing query SHOW DATABASES on instance http://localhost:None "GET /v1.46/containers/dbda782b00998c3da431c550350bacc2a76b6eaf5a4feef76df3edcc119658a3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/dbda782b00998c3da431c550350bacc2a76b6eaf5a4feef76df3edcc119658a3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4d6a91373b8d5d89a7296847301134abbe4e2419a4e6dfeba0231c8fb6ffc551/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4d6a91373b8d5d89a7296847301134abbe4e2419a4e6dfeba0231c8fb6ffc551/json HTTP/1.1" 200 None ClickHouse node1 started ClickHouse node1 started Executing query drop table if exists s3_low_cardinality on node1 Executing query drop table if exists s3_low_cardinality on node1 Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) http://localhost:None "GET /v1.46/containers/dbda782b00998c3da431c550350bacc2a76b6eaf5a4feef76df3edcc119658a3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/dbda782b00998c3da431c550350bacc2a76b6eaf5a4feef76df3edcc119658a3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['zookeeper'] Received response(xid=1): ['zookeeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Closing connection to 172.16.4.4:2281 Closing connection to 172.16.4.4:2281 Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --project-name roottestreloadclientcertificate-gw8 --file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml --file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/node2/docker-compose.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --project-name roottestreloadclientcertificate-gw8 --file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml --file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/node2/docker-compose.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --project-name roottestreloadclientcertificate-gw8 --file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml --file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/node2/docker-compose.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --project-name roottestreloadclientcertificate-gw8 --file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml --file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/node2/docker-compose.yml up -d --no-recreate] Executing query INSERT INTO postgres_database.test_data_types VALUES (0, -32768, -2147483648, -9223372036854775808, 1.12345, 1.1234567890, 2147483647, 9223372036854775807, '2000-05-12 12:12:12.012345', '2000-05-12', 0.2, 0.2) on instance Executing query INSERT INTO postgres_database.test_data_types VALUES (0, -32768, -2147483648, -9223372036854775808, 1.12345, 1.1234567890, 2147483647, 9223372036854775807, '2000-05-12 12:12:12.012345', '2000-05-12', 0.2, 0.2) on instance http://localhost:None "GET /v1.46/containers/dbda782b00998c3da431c550350bacc2a76b6eaf5a4feef76df3edcc119658a3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/dbda782b00998c3da431c550350bacc2a76b6eaf5a4feef76df3edcc119658a3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Connecting to 172.16.6.2(172.16.6.2):2181, use_ssl: False Connecting to 172.16.6.2(172.16.6.2):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Executing query CREATE TABLE s3_low_cardinality ( str_column LowCardinality(String) ) ENGINE = MergeTree() ORDER BY tuple() SETTINGS storage_policy = 's3', min_bytes_for_wide_part = 0, index_granularity = 1024; on node1 Executing query CREATE TABLE s3_low_cardinality ( str_column LowCardinality(String) ) ENGINE = MergeTree() ORDER BY tuple() SETTINGS storage_policy = 's3', min_bytes_for_wide_part = 0, index_granularity = 1024; on node1 Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost http://localhost:None "GET /v1.46/containers/dbda782b00998c3da431c550350bacc2a76b6eaf5a4feef76df3edcc119658a3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/dbda782b00998c3da431c550350bacc2a76b6eaf5a4feef76df3edcc119658a3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo2 get_instance_ip instance_name=zoo2 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw5-zoo2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw5-zoo2-1/json HTTP/1.1" 200 None get_kazoo_client: zoo2, ip:172.16.6.3, port:2181, use_ssl:False get_kazoo_client: zoo2, ip:172.16.6.3, port:2181, use_ssl:False Connecting to 172.16.6.3(172.16.6.3):2181, use_ssl: False Connecting to 172.16.6.3(172.16.6.3):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Executing query INSERT INTO postgres_database.test_data_types VALUES (1, -32768, -2147483648, -9223372036854775808, 1.12345, 1.1234567890, 2147483647, 9223372036854775807, '2000-05-12 12:12:12.012345', '2000-05-12', 0.2, 0.2) on instance Executing query INSERT INTO postgres_database.test_data_types VALUES (1, -32768, -2147483648, -9223372036854775808, 1.12345, 1.1234567890, 2147483647, 9223372036854775807, '2000-05-12 12:12:12.012345', '2000-05-12', 0.2, 0.2) on instance http://localhost:None "GET /v1.46/containers/dbda782b00998c3da431c550350bacc2a76b6eaf5a4feef76df3edcc119658a3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/dbda782b00998c3da431c550350bacc2a76b6eaf5a4feef76df3edcc119658a3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo3 get_instance_ip instance_name=zoo3 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw5-zoo3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw5-zoo3-1/json HTTP/1.1" 200 None get_kazoo_client: zoo3, ip:172.16.6.4, port:2181, use_ssl:False get_kazoo_client: zoo3, ip:172.16.6.4, port:2181, use_ssl:False Connecting to 172.16.6.4(172.16.6.4):2181, use_ssl: False Connecting to 172.16.6.4(172.16.6.4):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost http://localhost:None "GET /v1.46/containers/dbda782b00998c3da431c550350bacc2a76b6eaf5a4feef76df3edcc119658a3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/dbda782b00998c3da431c550350bacc2a76b6eaf5a4feef76df3edcc119658a3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') Trying to create Minio instance by command docker compose --project-name roottestreplicatedmergetrees3zerocopy-gw5 --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Trying to create Minio instance by command docker compose --project-name roottestreplicatedmergetrees3zerocopy-gw5 --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Command:[docker compose --project-name roottestreplicatedmergetrees3zerocopy-gw5 --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Command:[docker compose --project-name roottestreplicatedmergetrees3zerocopy-gw5 --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] http://localhost:None "GET /v1.46/containers/dbda782b00998c3da431c550350bacc2a76b6eaf5a4feef76df3edcc119658a3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/dbda782b00998c3da431c550350bacc2a76b6eaf5a4feef76df3edcc119658a3/json HTTP/1.1" 200 None ClickHouse remote_proxy_node started ClickHouse remote_proxy_node started get_instance_ip instance_name=remote_proxy_node_no_proxy get_instance_ip instance_name=remote_proxy_node_no_proxy http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node_no_proxy-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node_no_proxy-1/json HTTP/1.1" 200 None get_instance_ip instance_name=remote_proxy_node_no_proxy get_instance_ip instance_name=remote_proxy_node_no_proxy http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node_no_proxy-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node_no_proxy-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in remote_proxy_node_no_proxy, ip: 172.16.10.9... Waiting for ClickHouse start in remote_proxy_node_no_proxy, ip: 172.16.10.9... http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node_no_proxy-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node_no_proxy-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e97225086060e8123f51710870fe614d8e1b880d1d8a62cf9061a922ddbea198/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e97225086060e8123f51710870fe614d8e1b880d1d8a62cf9061a922ddbea198/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Stderr: Container roottestrenamecolumn-gw0-zoo3-1 Running Stderr: Container roottestrenamecolumn-gw0-zoo3-1 Running Stderr: Container roottestrenamecolumn-gw0-zoo1-1 Running Stderr: Container roottestrenamecolumn-gw0-zoo1-1 Running Stderr: Container roottestrenamecolumn-gw0-zoo2-1 Running Stderr: Container roottestrenamecolumn-gw0-zoo2-1 Running Stderr: Container roottestrenamecolumn-gw0-node3-1 Creating Stderr: Container roottestrenamecolumn-gw0-node3-1 Creating Stderr: Container roottestrenamecolumn-gw0-node4-1 Creating Stderr: Container roottestrenamecolumn-gw0-node4-1 Creating Stderr: Container roottestrenamecolumn-gw0-node2-1 Creating Stderr: Container roottestrenamecolumn-gw0-node2-1 Creating Stderr: Container roottestrenamecolumn-gw0-node1-1 Creating Stderr: Container roottestrenamecolumn-gw0-node1-1 Creating Stderr: Container roottestrenamecolumn-gw0-node1-1 Created Stderr: Container roottestrenamecolumn-gw0-node1-1 Created Stderr: Container roottestrenamecolumn-gw0-node4-1 Created Stderr: Container roottestrenamecolumn-gw0-node4-1 Created Stderr: Container roottestrenamecolumn-gw0-node2-1 Created Stderr: Container roottestrenamecolumn-gw0-node2-1 Created Stderr: Container roottestrenamecolumn-gw0-node3-1 Created Stderr: Container roottestrenamecolumn-gw0-node3-1 Created Stderr: Container roottestrenamecolumn-gw0-node2-1 Starting Stderr: Container roottestrenamecolumn-gw0-node2-1 Starting Stderr: Container roottestrenamecolumn-gw0-node3-1 Starting Stderr: Container roottestrenamecolumn-gw0-node3-1 Starting Stderr: Container roottestrenamecolumn-gw0-node4-1 Starting Stderr: Container roottestrenamecolumn-gw0-node4-1 Starting Stderr: Container roottestrenamecolumn-gw0-node1-1 Starting Stderr: Container roottestrenamecolumn-gw0-node1-1 Starting Stderr: Container roottestrenamecolumn-gw0-node3-1 Started Stderr: Container roottestrenamecolumn-gw0-node3-1 Started Stderr: Container roottestrenamecolumn-gw0-node1-1 Started Stderr: Container roottestrenamecolumn-gw0-node1-1 Started Stderr: Container roottestrenamecolumn-gw0-node4-1 Started Stderr: Container roottestrenamecolumn-gw0-node4-1 Started Stderr: Container roottestrenamecolumn-gw0-node2-1 Started Stderr: Container roottestrenamecolumn-gw0-node2-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node1 get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw0-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw0-node1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node1 get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw0-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw0-node1-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node1, ip: 172.16.1.5... Waiting for ClickHouse start in node1, ip: 172.16.1.5... http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw0-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw0-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f72d874c9fc84a2a8c7e3763ce049155f3a5cc8aa2c68917543f1d5ad81c9e50/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f72d874c9fc84a2a8c7e3763ce049155f3a5cc8aa2c68917543f1d5ad81c9e50/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e97225086060e8123f51710870fe614d8e1b880d1d8a62cf9061a922ddbea198/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e97225086060e8123f51710870fe614d8e1b880d1d8a62cf9061a922ddbea198/json HTTP/1.1" 200 None ClickHouse remote_proxy_node_no_proxy started ClickHouse remote_proxy_node_no_proxy started get_instance_ip instance_name=proxy_list_node get_instance_ip instance_name=proxy_list_node http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node-1/json HTTP/1.1" 200 None get_instance_ip instance_name=proxy_list_node get_instance_ip instance_name=proxy_list_node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in proxy_list_node, ip: 172.16.10.10... Waiting for ClickHouse start in proxy_list_node, ip: 172.16.10.10... http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7c85e7a85414b5583999973bdc1c14d56d33739cdba39b80cf1f9769fa3a8ad3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7c85e7a85414b5583999973bdc1c14d56d33739cdba39b80cf1f9769fa3a8ad3/json HTTP/1.1" 200 None Executing query INSERT INTO s3_low_cardinality SELECT 'aaaaaa' FROM numbers(600000) on node1 Executing query INSERT INTO s3_low_cardinality SELECT 'aaaaaa' FROM numbers(600000) on node1 Executing query INSERT INTO postgres_database.test_data_types VALUES (2, -32768, -2147483648, -9223372036854775808, 1.12345, 1.1234567890, 2147483647, 9223372036854775807, '2000-05-12 12:12:12.012345', '2000-05-12', 0.2, 0.2) on instance Executing query INSERT INTO postgres_database.test_data_types VALUES (2, -32768, -2147483648, -9223372036854775808, 1.12345, 1.1234567890, 2147483647, 9223372036854775807, '2000-05-12 12:12:12.012345', '2000-05-12', 0.2, 0.2) on instance run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] http://localhost:None "GET /v1.46/containers/f72d874c9fc84a2a8c7e3763ce049155f3a5cc8aa2c68917543f1d5ad81c9e50/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f72d874c9fc84a2a8c7e3763ce049155f3a5cc8aa2c68917543f1d5ad81c9e50/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7c85e7a85414b5583999973bdc1c14d56d33739cdba39b80cf1f9769fa3a8ad3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7c85e7a85414b5583999973bdc1c14d56d33739cdba39b80cf1f9769fa3a8ad3/json HTTP/1.1" 200 None ClickHouse proxy_list_node started ClickHouse proxy_list_node started get_instance_ip instance_name=proxy_list_node_no_proxy get_instance_ip instance_name=proxy_list_node_no_proxy http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node_no_proxy-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node_no_proxy-1/json HTTP/1.1" 200 None get_instance_ip instance_name=proxy_list_node_no_proxy get_instance_ip instance_name=proxy_list_node_no_proxy http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node_no_proxy-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node_no_proxy-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in proxy_list_node_no_proxy, ip: 172.16.10.11... Waiting for ClickHouse start in proxy_list_node_no_proxy, ip: 172.16.10.11... http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node_no_proxy-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node_no_proxy-1/json HTTP/1.1" 200 None Stdout:757 Stdout:757 Clickhouse process running. Clickhouse process running. run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] http://localhost:None "GET /v1.46/containers/61e2f18b1dcf7a8d28384f1e8501c6f4e8fa757404abd8d55c5ea52c696d3bcd/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/61e2f18b1dcf7a8d28384f1e8501c6f4e8fa757404abd8d55c5ea52c696d3bcd/json HTTP/1.1" 200 None ClickHouse proxy_list_node_no_proxy started ClickHouse proxy_list_node_no_proxy started get_instance_ip instance_name=env_node get_instance_ip instance_name=env_node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-env_node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-env_node-1/json HTTP/1.1" 200 None get_instance_ip instance_name=env_node get_instance_ip instance_name=env_node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-env_node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-env_node-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in env_node, ip: 172.16.10.7... Waiting for ClickHouse start in env_node, ip: 172.16.10.7... http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-env_node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-env_node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e54f73d7303253a3492b4de1e2c3e6812fca96af435ac0b196cd87efc983acc8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e54f73d7303253a3492b4de1e2c3e6812fca96af435ac0b196cd87efc983acc8/json HTTP/1.1" 200 None ClickHouse env_node started ClickHouse env_node started get_instance_ip instance_name=env_node_no_proxy get_instance_ip instance_name=env_node_no_proxy http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-env_node_no_proxy-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-env_node_no_proxy-1/json HTTP/1.1" 200 None get_instance_ip instance_name=env_node_no_proxy get_instance_ip instance_name=env_node_no_proxy http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-env_node_no_proxy-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-env_node_no_proxy-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in env_node_no_proxy, ip: 172.16.10.6... Waiting for ClickHouse start in env_node_no_proxy, ip: 172.16.10.6... http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-env_node_no_proxy-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-env_node_no_proxy-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f4eed2ff21216c956cad2c0f594083eaf7201b5396cfe53e7ad43009a94c5598/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f4eed2ff21216c956cad2c0f594083eaf7201b5396cfe53e7ad43009a94c5598/json HTTP/1.1" 200 None ClickHouse env_node_no_proxy started ClickHouse env_node_no_proxy started Cluster started Cluster started run container_id:roottests3tablefunctionwithhttpproxy-gw6-resolver-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname resolver.py) && echo aW1wb3J0IHJhbmRvbQoKaW1wb3J0IGJvdHRsZQoKCkBib3R0bGUucm91dGUoIi9ob3N0bmFtZSIpCmRlZiBpbmRleCgpOgogICAgaWYgcmFuZG9tLnJhbmRyYW5nZSgyKSA9PSAwOgogICAgICAgIHJldHVybiAicHJveHkxIgogICAgZWxzZToKICAgICAgICByZXR1cm4gInByb3h5MiIKCgpib3R0bGUucnVuKGhvc3Q9IjAuMC4wLjAiLCBwb3J0PTgwODApCg== | base64 --decode > resolver.py'] run container_id:roottests3tablefunctionwithhttpproxy-gw6-resolver-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname resolver.py) && echo aW1wb3J0IHJhbmRvbQoKaW1wb3J0IGJvdHRsZQoKCkBib3R0bGUucm91dGUoIi9ob3N0bmFtZSIpCmRlZiBpbmRleCgpOgogICAgaWYgcmFuZG9tLnJhbmRyYW5nZSgyKSA9PSAwOgogICAgICAgIHJldHVybiAicHJveHkxIgogICAgZWxzZToKICAgICAgICByZXR1cm4gInByb3h5MiIKCgpib3R0bGUucnVuKGhvc3Q9IjAuMC4wLjAiLCBwb3J0PTgwODApCg== | base64 --decode > resolver.py'] Command:[docker exec roottests3tablefunctionwithhttpproxy-gw6-resolver-1 bash -c mkdir -p $(dirname resolver.py) && echo aW1wb3J0IHJhbmRvbQoKaW1wb3J0IGJvdHRsZQoKCkBib3R0bGUucm91dGUoIi9ob3N0bmFtZSIpCmRlZiBpbmRleCgpOgogICAgaWYgcmFuZG9tLnJhbmRyYW5nZSgyKSA9PSAwOgogICAgICAgIHJldHVybiAicHJveHkxIgogICAgZWxzZToKICAgICAgICByZXR1cm4gInByb3h5MiIKCgpib3R0bGUucnVuKGhvc3Q9IjAuMC4wLjAiLCBwb3J0PTgwODApCg== | base64 --decode > resolver.py] Command:[docker exec roottests3tablefunctionwithhttpproxy-gw6-resolver-1 bash -c mkdir -p $(dirname resolver.py) && echo aW1wb3J0IHJhbmRvbQoKaW1wb3J0IGJvdHRsZQoKCkBib3R0bGUucm91dGUoIi9ob3N0bmFtZSIpCmRlZiBpbmRleCgpOgogICAgaWYgcmFuZG9tLnJhbmRyYW5nZSgyKSA9PSAwOgogICAgICAgIHJldHVybiAicHJveHkxIgogICAgZWxzZToKICAgICAgICByZXR1cm4gInByb3h5MiIKCgpib3R0bGUucnVuKGhvc3Q9IjAuMC4wLjAiLCBwb3J0PTgwODApCg== | base64 --decode > resolver.py] Stdout:757 Stdout:757 Executing query select 20 on node Executing query select 20 on node http://localhost:None "GET /v1.46/containers/f72d874c9fc84a2a8c7e3763ce049155f3a5cc8aa2c68917543f1d5ad81c9e50/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f72d874c9fc84a2a8c7e3763ce049155f3a5cc8aa2c68917543f1d5ad81c9e50/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None run container_id:roottests3tablefunctionwithhttpproxy-gw6-resolver-1 detach:True nothrow:False cmd: ['python', 'resolver.py'] run container_id:roottests3tablefunctionwithhttpproxy-gw6-resolver-1 detach:True nothrow:False cmd: ['python', 'resolver.py'] Command:[docker exec roottests3tablefunctionwithhttpproxy-gw6-resolver-1 python resolver.py] Command:[docker exec roottests3tablefunctionwithhttpproxy-gw6-resolver-1 python resolver.py] run container_id:roottests3tablefunctionwithhttpproxy-gw6-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://resolver:8080/hostname'] run container_id:roottests3tablefunctionwithhttpproxy-gw6-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://resolver:8080/hostname'] Command:[docker exec roottests3tablefunctionwithhttpproxy-gw6-resolver-1 curl -s http://resolver:8080/hostname] Command:[docker exec roottests3tablefunctionwithhttpproxy-gw6-resolver-1 curl -s http://resolver:8080/hostname] http://localhost:None "GET /v1.46/containers/f72d874c9fc84a2a8c7e3763ce049155f3a5cc8aa2c68917543f1d5ad81c9e50/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f72d874c9fc84a2a8c7e3763ce049155f3a5cc8aa2c68917543f1d5ad81c9e50/json HTTP/1.1" 200 None Exitcode:7 Exitcode:7 run container_id:roottests3tablefunctionwithhttpproxy-gw6-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://resolver:8080/hostname'] run container_id:roottests3tablefunctionwithhttpproxy-gw6-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://resolver:8080/hostname'] Command:[docker exec roottests3tablefunctionwithhttpproxy-gw6-resolver-1 curl -s http://resolver:8080/hostname] Command:[docker exec roottests3tablefunctionwithhttpproxy-gw6-resolver-1 curl -s http://resolver:8080/hostname] http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Stderr: Container roottestreloadclientcertificate-gw8-node2-1 Creating Stderr: Container roottestreloadclientcertificate-gw8-node2-1 Creating Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Running Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Running Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Running Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Running Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Running Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Running Stderr: Container roottestreloadclientcertificate-gw8-node1-1 Creating Stderr: Container roottestreloadclientcertificate-gw8-node1-1 Creating Stderr: Container roottestreloadclientcertificate-gw8-node1-1 Created Stderr: Container roottestreloadclientcertificate-gw8-node1-1 Created Stderr: Container roottestreloadclientcertificate-gw8-node2-1 Created Stderr: Container roottestreloadclientcertificate-gw8-node2-1 Created Stderr: Container roottestreloadclientcertificate-gw8-node2-1 Starting Stderr: Container roottestreloadclientcertificate-gw8-node2-1 Starting Stderr: Container roottestreloadclientcertificate-gw8-node1-1 Starting Stderr: Container roottestreloadclientcertificate-gw8-node1-1 Starting Stderr: Container roottestreloadclientcertificate-gw8-node1-1 Started Stderr: Container roottestreloadclientcertificate-gw8-node1-1 Started Stderr: Container roottestreloadclientcertificate-gw8-node2-1 Started Stderr: Container roottestreloadclientcertificate-gw8-node2-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node1 get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw8-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw8-node1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node1 get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw8-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw8-node1-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node1, ip: 172.16.4.6... Waiting for ClickHouse start in node1, ip: 172.16.4.6... http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw8-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw8-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e4ddb2be8efcef5c3c8c3d3074e5369941dd21c47d915186888256df0f02c15a/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e4ddb2be8efcef5c3c8c3d3074e5369941dd21c47d915186888256df0f02c15a/json HTTP/1.1" 200 None Executing query INSERT INTO postgres_database.test_data_types VALUES (3, -32768, -2147483648, -9223372036854775808, 1.12345, 1.1234567890, 2147483647, 9223372036854775807, '2000-05-12 12:12:12.012345', '2000-05-12', 0.2, 0.2) on instance Executing query INSERT INTO postgres_database.test_data_types VALUES (3, -32768, -2147483648, -9223372036854775808, 1.12345, 1.1234567890, 2147483647, 9223372036854775807, '2000-05-12 12:12:12.012345', '2000-05-12', 0.2, 0.2) on instance Exitcode:7 Exitcode:7 http://localhost:None "GET /v1.46/containers/f72d874c9fc84a2a8c7e3763ce049155f3a5cc8aa2c68917543f1d5ad81c9e50/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f72d874c9fc84a2a8c7e3763ce049155f3a5cc8aa2c68917543f1d5ad81c9e50/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Executing query INSERT INTO s3_low_cardinality SELECT toString(number) FROM numbers(100000) on node1 Executing query INSERT INTO s3_low_cardinality SELECT toString(number) FROM numbers(100000) on node1 http://localhost:None "GET /v1.46/containers/e4ddb2be8efcef5c3c8c3d3074e5369941dd21c47d915186888256df0f02c15a/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e4ddb2be8efcef5c3c8c3d3074e5369941dd21c47d915186888256df0f02c15a/json HTTP/1.1" 200 None Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo2 get_instance_ip instance_name=zoo2 http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-zoo2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-zoo2-1/json HTTP/1.1" 200 None get_kazoo_client: zoo2, ip:172.16.9.4, port:2181, use_ssl:False get_kazoo_client: zoo2, ip:172.16.9.4, port:2181, use_ssl:False Connecting to 172.16.9.4(172.16.9.4):2181, use_ssl: False Connecting to 172.16.9.4(172.16.9.4):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) http://localhost:None "GET /v1.46/containers/f72d874c9fc84a2a8c7e3763ce049155f3a5cc8aa2c68917543f1d5ad81c9e50/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f72d874c9fc84a2a8c7e3763ce049155f3a5cc8aa2c68917543f1d5ad81c9e50/json HTTP/1.1" 200 None Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e4ddb2be8efcef5c3c8c3d3074e5369941dd21c47d915186888256df0f02c15a/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e4ddb2be8efcef5c3c8c3d3074e5369941dd21c47d915186888256df0f02c15a/json HTTP/1.1" 200 None Executing query INSERT INTO postgres_database.test_data_types VALUES (4, -32768, -2147483648, -9223372036854775808, 1.12345, 1.1234567890, 2147483647, 9223372036854775807, '2000-05-12 12:12:12.012345', '2000-05-12', 0.2, 0.2) on instance Executing query INSERT INTO postgres_database.test_data_types VALUES (4, -32768, -2147483648, -9223372036854775808, 1.12345, 1.1234567890, 2147483647, 9223372036854775807, '2000-05-12 12:12:12.012345', '2000-05-12', 0.2, 0.2) on instance http://localhost:None "GET /v1.46/containers/f72d874c9fc84a2a8c7e3763ce049155f3a5cc8aa2c68917543f1d5ad81c9e50/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f72d874c9fc84a2a8c7e3763ce049155f3a5cc8aa2c68917543f1d5ad81c9e50/json HTTP/1.1" 200 None Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo3 get_instance_ip instance_name=zoo3 http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-zoo3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-zoo3-1/json HTTP/1.1" 200 None get_kazoo_client: zoo3, ip:172.16.9.3, port:2181, use_ssl:False get_kazoo_client: zoo3, ip:172.16.9.3, port:2181, use_ssl:False Connecting to 172.16.9.3(172.16.9.3):2181, use_ssl: False Connecting to 172.16.9.3(172.16.9.3):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Connecting to 172.16.8.4(172.16.8.4):2181, use_ssl: False Connecting to 172.16.8.4(172.16.8.4):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) http://localhost:None "GET /v1.46/containers/e4ddb2be8efcef5c3c8c3d3074e5369941dd21c47d915186888256df0f02c15a/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e4ddb2be8efcef5c3c8c3d3074e5369941dd21c47d915186888256df0f02c15a/json HTTP/1.1" 200 None Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost http://localhost:None "GET /v1.46/containers/f72d874c9fc84a2a8c7e3763ce049155f3a5cc8aa2c68917543f1d5ad81c9e50/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f72d874c9fc84a2a8c7e3763ce049155f3a5cc8aa2c68917543f1d5ad81c9e50/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --project-name roottestreplicateduserdefinedfunctions-gw2 --file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node2/docker-compose.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --project-name roottestreplicateduserdefinedfunctions-gw2 --file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node2/docker-compose.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --project-name roottestreplicateduserdefinedfunctions-gw2 --file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node2/docker-compose.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --project-name roottestreplicateduserdefinedfunctions-gw2 --file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node2/docker-compose.yml up -d --no-recreate] Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo2 get_instance_ip instance_name=zoo2 http://localhost:None "GET /v1.46/containers/roottestscheduler-gw3-zoo2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestscheduler-gw3-zoo2-1/json HTTP/1.1" 200 None get_kazoo_client: zoo2, ip:172.16.8.2, port:2181, use_ssl:False get_kazoo_client: zoo2, ip:172.16.8.2, port:2181, use_ssl:False Connecting to 172.16.8.2(172.16.8.2):2181, use_ssl: False Connecting to 172.16.8.2(172.16.8.2):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Executing query INSERT INTO s3_low_cardinality SELECT 'bbbbbb' FROM numbers(500000) on node1 Executing query INSERT INTO s3_low_cardinality SELECT 'bbbbbb' FROM numbers(500000) on node1 http://localhost:None "GET /v1.46/containers/e4ddb2be8efcef5c3c8c3d3074e5369941dd21c47d915186888256df0f02c15a/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e4ddb2be8efcef5c3c8c3d3074e5369941dd21c47d915186888256df0f02c15a/json HTTP/1.1" 200 None Stderr:time="2025-04-02T02:52:53Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:52:53Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Volume "roottestreplicatedmergetrees3zerocopy-gw5_data1-1" Creating Stderr: Volume "roottestreplicatedmergetrees3zerocopy-gw5_data1-1" Creating Stderr: Volume "roottestreplicatedmergetrees3zerocopy-gw5_data1-1" Created Stderr: Volume "roottestreplicatedmergetrees3zerocopy-gw5_data1-1" Created Stderr:time="2025-04-02T02:52:53Z" level=warning msg="Found orphan containers ([roottestreplicatedmergetrees3zerocopy-gw5-zoo1-1 roottestreplicatedmergetrees3zerocopy-gw5-zoo2-1 roottestreplicatedmergetrees3zerocopy-gw5-zoo3-1]) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up." Stderr:time="2025-04-02T02:52:53Z" level=warning msg="Found orphan containers ([roottestreplicatedmergetrees3zerocopy-gw5-zoo1-1 roottestreplicatedmergetrees3zerocopy-gw5-zoo2-1 roottestreplicatedmergetrees3zerocopy-gw5-zoo3-1]) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up." Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-proxy1-1 Creating Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-proxy1-1 Creating Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-proxy2-1 Creating Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-proxy2-1 Creating Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-proxy1-1 Created Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-proxy1-1 Created Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-proxy2-1 Created Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-proxy2-1 Created Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-minio1-1 Creating Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-minio1-1 Creating Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-resolver-1 Creating Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-resolver-1 Creating Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-minio1-1 Created Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-minio1-1 Created Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-resolver-1 Created Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-resolver-1 Created Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-proxy1-1 Starting Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-proxy1-1 Starting Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-proxy2-1 Starting Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-proxy2-1 Starting Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-proxy1-1 Started Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-proxy1-1 Started Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-proxy2-1 Started Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-proxy2-1 Started Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-resolver-1 Starting Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-resolver-1 Starting Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-minio1-1 Starting Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-minio1-1 Starting Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-minio1-1 Started Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-minio1-1 Started Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-resolver-1 Started Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-resolver-1 Started Stderr:time="2025-04-02T02:52:54Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:52:54Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:52:54Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:52:54Z" level=debug msg="otel error" error="" Trying to connect to Minio... Trying to connect to Minio... get_instance_ip instance_name=minio1 get_instance_ip instance_name=minio1 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw5-minio1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw5-minio1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=proxy1 get_instance_ip instance_name=proxy1 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw5-proxy1-1/json HTTP/1.1" 200 None Starting new HTTP connection (1): 172.16.6.7:9001 Starting new HTTP connection (1): 172.16.6.7:9001 Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (2): 172.16.6.7:9001 Starting new HTTP connection (2): 172.16.6.7:9001 Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (3): 172.16.6.7:9001 Starting new HTTP connection (3): 172.16.6.7:9001 Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (4): 172.16.6.7:9001 Starting new HTTP connection (4): 172.16.6.7:9001 Can't connect to Minio: HTTPConnectionPool(host='172.16.6.7', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Can't connect to Minio: HTTPConnectionPool(host='172.16.6.7', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo3 get_instance_ip instance_name=zoo3 http://localhost:None "GET /v1.46/containers/roottestscheduler-gw3-zoo3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestscheduler-gw3-zoo3-1/json HTTP/1.1" 200 None get_kazoo_client: zoo3, ip:172.16.8.3, port:2181, use_ssl:False get_kazoo_client: zoo3, ip:172.16.8.3, port:2181, use_ssl:False Connecting to 172.16.8.3(172.16.8.3):2181, use_ssl: False Connecting to 172.16.8.3(172.16.8.3):2181, use_ssl: False http://localhost:None "GET /v1.46/containers/f72d874c9fc84a2a8c7e3763ce049155f3a5cc8aa2c68917543f1d5ad81c9e50/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f72d874c9fc84a2a8c7e3763ce049155f3a5cc8aa2c68917543f1d5ad81c9e50/json HTTP/1.1" 200 None Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Executing query INSERT INTO postgres_database.test_data_types VALUES (5, -32768, -2147483648, -9223372036854775808, 1.12345, 1.1234567890, 2147483647, 9223372036854775807, '2000-05-12 12:12:12.012345', '2000-05-12', 0.2, 0.2) on instance Executing query INSERT INTO postgres_database.test_data_types VALUES (5, -32768, -2147483648, -9223372036854775808, 1.12345, 1.1234567890, 2147483647, 9223372036854775807, '2000-05-12 12:12:12.012345', '2000-05-12', 0.2, 0.2) on instance http://localhost:None "GET /v1.46/containers/e4ddb2be8efcef5c3c8c3d3074e5369941dd21c47d915186888256df0f02c15a/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e4ddb2be8efcef5c3c8c3d3074e5369941dd21c47d915186888256df0f02c15a/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f72d874c9fc84a2a8c7e3763ce049155f3a5cc8aa2c68917543f1d5ad81c9e50/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f72d874c9fc84a2a8c7e3763ce049155f3a5cc8aa2c68917543f1d5ad81c9e50/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') Trying to create Minio instance by command docker compose --project-name roottestscheduler-gw3 --env-file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Trying to create Minio instance by command docker compose --project-name roottestscheduler-gw3 --env-file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Command:[docker compose --project-name roottestscheduler-gw3 --env-file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Command:[docker compose --project-name roottestscheduler-gw3 --env-file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] http://localhost:None "GET /v1.46/containers/e4ddb2be8efcef5c3c8c3d3074e5369941dd21c47d915186888256df0f02c15a/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e4ddb2be8efcef5c3c8c3d3074e5369941dd21c47d915186888256df0f02c15a/json HTTP/1.1" 200 None Executing query select 20 on node Executing query select 20 on node Executing query INSERT INTO s3_low_cardinality SELECT toString(number + 100000000) FROM numbers(100000) on node1 Executing query INSERT INTO s3_low_cardinality SELECT toString(number + 100000000) FROM numbers(100000) on node1 http://localhost:None "GET /v1.46/containers/f72d874c9fc84a2a8c7e3763ce049155f3a5cc8aa2c68917543f1d5ad81c9e50/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f72d874c9fc84a2a8c7e3763ce049155f3a5cc8aa2c68917543f1d5ad81c9e50/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Executing query INSERT INTO postgres_database.test_data_types VALUES (6, -32768, -2147483648, -9223372036854775808, 1.12345, 1.1234567890, 2147483647, 9223372036854775807, '2000-05-12 12:12:12.012345', '2000-05-12', 0.2, 0.2) on instance Executing query INSERT INTO postgres_database.test_data_types VALUES (6, -32768, -2147483648, -9223372036854775808, 1.12345, 1.1234567890, 2147483647, 9223372036854775807, '2000-05-12 12:12:12.012345', '2000-05-12', 0.2, 0.2) on instance http://localhost:None "GET /v1.46/containers/e4ddb2be8efcef5c3c8c3d3074e5369941dd21c47d915186888256df0f02c15a/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e4ddb2be8efcef5c3c8c3d3074e5369941dd21c47d915186888256df0f02c15a/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f72d874c9fc84a2a8c7e3763ce049155f3a5cc8aa2c68917543f1d5ad81c9e50/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f72d874c9fc84a2a8c7e3763ce049155f3a5cc8aa2c68917543f1d5ad81c9e50/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e4ddb2be8efcef5c3c8c3d3074e5369941dd21c47d915186888256df0f02c15a/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e4ddb2be8efcef5c3c8c3d3074e5369941dd21c47d915186888256df0f02c15a/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f72d874c9fc84a2a8c7e3763ce049155f3a5cc8aa2c68917543f1d5ad81c9e50/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f72d874c9fc84a2a8c7e3763ce049155f3a5cc8aa2c68917543f1d5ad81c9e50/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Running Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Running Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Running Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Running Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Running Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Running Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node1-1 Creating Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node1-1 Creating Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node2-1 Creating Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node2-1 Creating Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node2-1 Created Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node2-1 Created Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node1-1 Created Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node1-1 Created Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node1-1 Starting Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node1-1 Starting Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node2-1 Starting Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node2-1 Starting Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node1-1 Started Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node1-1 Started Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node2-1 Started Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node2-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node1 get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-node1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node1 get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-node1-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node1, ip: 172.16.9.6... Waiting for ClickHouse start in node1, ip: 172.16.9.6... http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e513388ea821489701a51157c76024f281d1ff2052d1c2245942441eb78b6e8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e513388ea821489701a51157c76024f281d1ff2052d1c2245942441eb78b6e8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e4ddb2be8efcef5c3c8c3d3074e5369941dd21c47d915186888256df0f02c15a/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e4ddb2be8efcef5c3c8c3d3074e5369941dd21c47d915186888256df0f02c15a/json HTTP/1.1" 200 None Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB PRIMARY KEY(key); on node Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB PRIMARY KEY(key); on node Executing query INSERT INTO postgres_database.test_data_types VALUES (7, -32768, -2147483648, -9223372036854775808, 1.12345, 1.1234567890, 2147483647, 9223372036854775807, '2000-05-12 12:12:12.012345', '2000-05-12', 0.2, 0.2) on instance Executing query INSERT INTO postgres_database.test_data_types VALUES (7, -32768, -2147483648, -9223372036854775808, 1.12345, 1.1234567890, 2147483647, 9223372036854775807, '2000-05-12 12:12:12.012345', '2000-05-12', 0.2, 0.2) on instance http://localhost:None "GET /v1.46/containers/f72d874c9fc84a2a8c7e3763ce049155f3a5cc8aa2c68917543f1d5ad81c9e50/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f72d874c9fc84a2a8c7e3763ce049155f3a5cc8aa2c68917543f1d5ad81c9e50/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None run container_id:roottests3tablefunctionwithhttpproxy-gw6-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://resolver:8080/hostname'] run container_id:roottests3tablefunctionwithhttpproxy-gw6-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://resolver:8080/hostname'] Command:[docker exec roottests3tablefunctionwithhttpproxy-gw6-resolver-1 curl -s http://resolver:8080/hostname] Command:[docker exec roottests3tablefunctionwithhttpproxy-gw6-resolver-1 curl -s http://resolver:8080/hostname] http://localhost:None "GET /v1.46/containers/2e513388ea821489701a51157c76024f281d1ff2052d1c2245942441eb78b6e8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e513388ea821489701a51157c76024f281d1ff2052d1c2245942441eb78b6e8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e4ddb2be8efcef5c3c8c3d3074e5369941dd21c47d915186888256df0f02c15a/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e4ddb2be8efcef5c3c8c3d3074e5369941dd21c47d915186888256df0f02c15a/json HTTP/1.1" 200 None Executing query OPTIMIZE TABLE s3_low_cardinality FINAL on node1 Executing query OPTIMIZE TABLE s3_low_cardinality FINAL on node1 Stdout:proxy2 Stdout:proxy2 Proxy resolver started Proxy resolver started Executing query INSERT INTO FUNCTION s3('http://minio1:9001/root/data/env_node_no_proxy/test.csv', 'minio', 'minio123', 'CSV', 'key String, value String') VALUES ('color','red'),('size','10') on env_node_no_proxy Executing query INSERT INTO FUNCTION s3('http://minio1:9001/root/data/env_node_no_proxy/test.csv', 'minio', 'minio123', 'CSV', 'key String, value String') VALUES ('color','red'),('size','10') on env_node_no_proxy http://localhost:None "GET /v1.46/containers/f72d874c9fc84a2a8c7e3763ce049155f3a5cc8aa2c68917543f1d5ad81c9e50/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f72d874c9fc84a2a8c7e3763ce049155f3a5cc8aa2c68917543f1d5ad81c9e50/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e513388ea821489701a51157c76024f281d1ff2052d1c2245942441eb78b6e8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e513388ea821489701a51157c76024f281d1ff2052d1c2245942441eb78b6e8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e4ddb2be8efcef5c3c8c3d3074e5369941dd21c47d915186888256df0f02c15a/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e4ddb2be8efcef5c3c8c3d3074e5369941dd21c47d915186888256df0f02c15a/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f72d874c9fc84a2a8c7e3763ce049155f3a5cc8aa2c68917543f1d5ad81c9e50/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f72d874c9fc84a2a8c7e3763ce049155f3a5cc8aa2c68917543f1d5ad81c9e50/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e513388ea821489701a51157c76024f281d1ff2052d1c2245942441eb78b6e8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e513388ea821489701a51157c76024f281d1ff2052d1c2245942441eb78b6e8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e4ddb2be8efcef5c3c8c3d3074e5369941dd21c47d915186888256df0f02c15a/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e4ddb2be8efcef5c3c8c3d3074e5369941dd21c47d915186888256df0f02c15a/json HTTP/1.1" 200 None ClickHouse node1 started ClickHouse node1 started get_instance_ip instance_name=node2 get_instance_ip instance_name=node2 http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw8-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw8-node2-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node2 get_instance_ip instance_name=node2 http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw8-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw8-node2-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node2, ip: 172.16.4.5... Waiting for ClickHouse start in node2, ip: 172.16.4.5... http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw8-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw8-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/21152ade4f7eca904bbfdde99a05b898fc8c4a7b790f6968c037978f5ec4684f/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/21152ade4f7eca904bbfdde99a05b898fc8c4a7b790f6968c037978f5ec4684f/json HTTP/1.1" 200 None ClickHouse node2 started ClickHouse node2 started run container_id:roottestreloadclientcertificate-gw8-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF\n\n \n \n /etc/clickhouse-server/config.d/second_client.crt\n /etc/clickhouse-server/config.d/second_client.key\n true\n true\n sslv2,sslv3\n true\n none\n \n RejectCertificateHandler\n \n \n \n\nEOF'] run container_id:roottestreloadclientcertificate-gw8-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF\n\n \n \n /etc/clickhouse-server/config.d/second_client.crt\n /etc/clickhouse-server/config.d/second_client.key\n true\n true\n sslv2,sslv3\n true\n none\n \n RejectCertificateHandler\n \n \n \n\nEOF'] Command:[docker exec roottestreloadclientcertificate-gw8-node1-1 bash -c cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF /etc/clickhouse-server/config.d/second_client.crt /etc/clickhouse-server/config.d/second_client.key true true sslv2,sslv3 true none RejectCertificateHandler EOF] Command:[docker exec roottestreloadclientcertificate-gw8-node1-1 bash -c cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF /etc/clickhouse-server/config.d/second_client.crt /etc/clickhouse-server/config.d/second_client.key true true sslv2,sslv3 true none RejectCertificateHandler EOF] http://localhost:None "GET /v1.46/containers/f72d874c9fc84a2a8c7e3763ce049155f3a5cc8aa2c68917543f1d5ad81c9e50/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f72d874c9fc84a2a8c7e3763ce049155f3a5cc8aa2c68917543f1d5ad81c9e50/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None ClickHouse node1 started ClickHouse node1 started get_instance_ip instance_name=node2 get_instance_ip instance_name=node2 http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw0-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw0-node2-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node2 get_instance_ip instance_name=node2 http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw0-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw0-node2-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node2, ip: 172.16.1.7... Waiting for ClickHouse start in node2, ip: 172.16.1.7... http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw0-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw0-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/0b712b84abfd24d8eb089b5fe77196232244cf0c814437db2d3cad3c19b3b7b7/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/0b712b84abfd24d8eb089b5fe77196232244cf0c814437db2d3cad3c19b3b7b7/json HTTP/1.1" 200 None ClickHouse node2 started ClickHouse node2 started get_instance_ip instance_name=node3 get_instance_ip instance_name=node3 http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw0-node3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw0-node3-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node3 get_instance_ip instance_name=node3 http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw0-node3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw0-node3-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node3, ip: 172.16.1.6... Waiting for ClickHouse start in node3, ip: 172.16.1.6... http://localhost:None "GET /v1.46/containers/2e513388ea821489701a51157c76024f281d1ff2052d1c2245942441eb78b6e8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e513388ea821489701a51157c76024f281d1ff2052d1c2245942441eb78b6e8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw0-node3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw0-node3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/08ec636a81313010fab8f306bfdf54484014b4b16edb2939f0ab951ed76515f2/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/08ec636a81313010fab8f306bfdf54484014b4b16edb2939f0ab951ed76515f2/json HTTP/1.1" 200 None ClickHouse node3 started ClickHouse node3 started get_instance_ip instance_name=node4 get_instance_ip instance_name=node4 http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw0-node4-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw0-node4-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node4 get_instance_ip instance_name=node4 http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw0-node4-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw0-node4-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node4, ip: 172.16.1.8... Waiting for ClickHouse start in node4, ip: 172.16.1.8... run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/no_such_block_based_table_options/block_size/g' /etc/clickhouse-server/config.d/rocksdb.xml"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/no_such_block_based_table_options/block_size/g' /etc/clickhouse-server/config.d/rocksdb.xml"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c sed -i 's/no_such_block_based_table_options/block_size/g' /etc/clickhouse-server/config.d/rocksdb.xml] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c sed -i 's/no_such_block_based_table_options/block_size/g' /etc/clickhouse-server/config.d/rocksdb.xml] run container_id:roottestreloadclientcertificate-gw8-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'touch /etc/clickhouse-server/config.d/ssl_conf.xml'] run container_id:roottestreloadclientcertificate-gw8-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'touch /etc/clickhouse-server/config.d/ssl_conf.xml'] Command:[docker exec roottestreloadclientcertificate-gw8-node1-1 bash -c touch /etc/clickhouse-server/config.d/ssl_conf.xml] Command:[docker exec roottestreloadclientcertificate-gw8-node1-1 bash -c touch /etc/clickhouse-server/config.d/ssl_conf.xml] Executing query INSERT INTO postgres_database.test_data_types VALUES (8, -32768, -2147483648, -9223372036854775808, 1.12345, 1.1234567890, 2147483647, 9223372036854775807, '2000-05-12 12:12:12.012345', '2000-05-12', 0.2, 0.2) on instance Executing query INSERT INTO postgres_database.test_data_types VALUES (8, -32768, -2147483648, -9223372036854775808, 1.12345, 1.1234567890, 2147483647, 9223372036854775807, '2000-05-12 12:12:12.012345', '2000-05-12', 0.2, 0.2) on instance http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw0-node4-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw0-node4-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/b5ad3421ded3e3f99b54fb619ed19346d0ddc4f04308b39faa5a6c3044a18e41/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/b5ad3421ded3e3f99b54fb619ed19346d0ddc4f04308b39faa5a6c3044a18e41/json HTTP/1.1" 200 None ClickHouse node4 started ClickHouse node4 started Executing query CREATE TABLE test_rename_distributed_replicated ON CLUSTER test_cluster ( num UInt32, num2 UInt32 DEFAULT num + 1 ) ENGINE = ReplicatedMergeTree('/clickhouse/tables/test/{shard}/test_rename_distributed_replicated', '{replica}') ORDER BY num PARTITION BY num % 100; on node1 Executing query SELECT * FROM s3('http://minio1:9001/root/data/env_node_no_proxy/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on env_node_no_proxy Executing query SELECT * FROM s3('http://minio1:9001/root/data/env_node_no_proxy/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on env_node_no_proxy http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Executing query CREATE TABLE test_rename_distributed_replicated ON CLUSTER test_cluster ( num UInt32, num2 UInt32 DEFAULT num + 1 ) ENGINE = ReplicatedMergeTree('/clickhouse/tables/test/{shard}/test_rename_distributed_replicated', '{replica}') ORDER BY num PARTITION BY num % 100; on node1 run container_id:roottestreloadclientcertificate-gw8-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF\n\n \n \n /etc/clickhouse-server/config.d/second_client.crt\n /etc/clickhouse-server/config.d/second_client.key\n true\n true\n sslv2,sslv3\n true\n none\n \n RejectCertificateHandler\n \n \n \n\nEOF'] run container_id:roottestreloadclientcertificate-gw8-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF\n\n \n \n /etc/clickhouse-server/config.d/second_client.crt\n /etc/clickhouse-server/config.d/second_client.key\n true\n true\n sslv2,sslv3\n true\n none\n \n RejectCertificateHandler\n \n \n \n\nEOF'] Command:[docker exec roottestreloadclientcertificate-gw8-node2-1 bash -c cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF /etc/clickhouse-server/config.d/second_client.crt /etc/clickhouse-server/config.d/second_client.key true true sslv2,sslv3 true none RejectCertificateHandler EOF] Command:[docker exec roottestreloadclientcertificate-gw8-node2-1 bash -c cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF /etc/clickhouse-server/config.d/second_client.crt /etc/clickhouse-server/config.d/second_client.key true true sslv2,sslv3 true none RejectCertificateHandler EOF] http://localhost:None "GET /v1.46/containers/2e513388ea821489701a51157c76024f281d1ff2052d1c2245942441eb78b6e8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e513388ea821489701a51157c76024f281d1ff2052d1c2245942441eb78b6e8/json HTTP/1.1" 200 None Starting new HTTP connection (5): 172.16.6.7:9001 Starting new HTTP connection (5): 172.16.6.7:9001 http://172.16.6.7:9001 "GET / HTTP/1.1" 200 0 http://172.16.6.7:9001 "GET / HTTP/1.1" 200 0 Connected to Minio. Connected to Minio. http://172.16.6.7:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.6.7:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.6.7:9001 "PUT /root HTTP/1.1" 200 0 http://172.16.6.7:9001 "PUT /root HTTP/1.1" 200 0 S3 bucket 'root' created S3 bucket 'root' created http://172.16.6.7:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.6.7:9001 "GET /root2?location= HTTP/1.1" 404 0 run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c ps -C clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c ps -C clickhouse] http://172.16.6.7:9001 "PUT /root2 HTTP/1.1" 200 0 http://172.16.6.7:9001 "PUT /root2 HTTP/1.1" 200 0 S3 bucket 'root2' created S3 bucket 'root2' created ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/.env --project-name roottestreplicatedmergetrees3zerocopy-gw5 --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node3/docker-compose.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/.env --project-name roottestreplicatedmergetrees3zerocopy-gw5 --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node3/docker-compose.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/.env --project-name roottestreplicatedmergetrees3zerocopy-gw5 --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node3/docker-compose.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/.env --project-name roottestreplicatedmergetrees3zerocopy-gw5 --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node3/docker-compose.yml up -d --no-recreate] run container_id:roottestreloadclientcertificate-gw8-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'touch /etc/clickhouse-server/config.d/ssl_conf.xml'] run container_id:roottestreloadclientcertificate-gw8-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'touch /etc/clickhouse-server/config.d/ssl_conf.xml'] Command:[docker exec roottestreloadclientcertificate-gw8-node2-1 bash -c touch /etc/clickhouse-server/config.d/ssl_conf.xml] Command:[docker exec roottestreloadclientcertificate-gw8-node2-1 bash -c touch /etc/clickhouse-server/config.d/ssl_conf.xml] http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Stdout: PID TTY TIME CMD Stdout: PID TTY TIME CMD Stdout: 757 ? 00:00:01 clickhouse Stdout: 757 ? 00:00:01 clickhouse run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c pkill clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c pkill clickhouse] Stopping zookeeper node: zoo1 Stopping zookeeper node: zoo1 Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo1] Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo1] http://localhost:None "GET /v1.46/containers/2e513388ea821489701a51157c76024f281d1ff2052d1c2245942441eb78b6e8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e513388ea821489701a51157c76024f281d1ff2052d1c2245942441eb78b6e8/json HTTP/1.1" 200 None run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:757 Stdout:757 http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e513388ea821489701a51157c76024f281d1ff2052d1c2245942441eb78b6e8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e513388ea821489701a51157c76024f281d1ff2052d1c2245942441eb78b6e8/json HTTP/1.1" 200 None Stderr:time="2025-04-02T02:52:54Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:52:54Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Volume "roottestscheduler-gw3_data1-1" Creating Stderr: Volume "roottestscheduler-gw3_data1-1" Creating Stderr: Volume "roottestscheduler-gw3_data1-1" Created Stderr: Volume "roottestscheduler-gw3_data1-1" Created Stderr:time="2025-04-02T02:52:54Z" level=warning msg="Found orphan containers ([roottestscheduler-gw3-zoo1-1 roottestscheduler-gw3-zoo3-1 roottestscheduler-gw3-zoo2-1]) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up." Stderr:time="2025-04-02T02:52:54Z" level=warning msg="Found orphan containers ([roottestscheduler-gw3-zoo1-1 roottestscheduler-gw3-zoo3-1 roottestscheduler-gw3-zoo2-1]) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up." Stderr: Container roottestscheduler-gw3-proxy1-1 Creating Stderr: Container roottestscheduler-gw3-proxy1-1 Creating Stderr: Container roottestscheduler-gw3-proxy2-1 Creating Stderr: Container roottestscheduler-gw3-proxy2-1 Creating Stderr: Container roottestscheduler-gw3-proxy1-1 Created Stderr: Container roottestscheduler-gw3-proxy1-1 Created Stderr: Container roottestscheduler-gw3-proxy2-1 Created Stderr: Container roottestscheduler-gw3-proxy2-1 Created Stderr: Container roottestscheduler-gw3-resolver-1 Creating Stderr: Container roottestscheduler-gw3-resolver-1 Creating Stderr: Container roottestscheduler-gw3-minio1-1 Creating Stderr: Container roottestscheduler-gw3-minio1-1 Creating Stderr: Container roottestscheduler-gw3-resolver-1 Created Stderr: Container roottestscheduler-gw3-resolver-1 Created Stderr: Container roottestscheduler-gw3-minio1-1 Created Stderr: Container roottestscheduler-gw3-minio1-1 Created Stderr: Container roottestscheduler-gw3-proxy2-1 Starting Stderr: Container roottestscheduler-gw3-proxy2-1 Starting Stderr: Container roottestscheduler-gw3-proxy1-1 Starting Stderr: Container roottestscheduler-gw3-proxy1-1 Starting Stderr: Container roottestscheduler-gw3-proxy1-1 Started Stderr: Container roottestscheduler-gw3-proxy1-1 Started Stderr: Container roottestscheduler-gw3-proxy2-1 Started Stderr: Container roottestscheduler-gw3-proxy2-1 Started Stderr: Container roottestscheduler-gw3-resolver-1 Starting Stderr: Container roottestscheduler-gw3-resolver-1 Starting Stderr: Container roottestscheduler-gw3-minio1-1 Starting Stderr: Container roottestscheduler-gw3-minio1-1 Starting Stderr: Container roottestscheduler-gw3-resolver-1 Started Stderr: Container roottestscheduler-gw3-resolver-1 Started Stderr: Container roottestscheduler-gw3-minio1-1 Started Stderr: Container roottestscheduler-gw3-minio1-1 Started Stderr:time="2025-04-02T02:52:55Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:52:55Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:52:55Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:52:55Z" level=debug msg="otel error" error="" Trying to connect to Minio... Trying to connect to Minio... get_instance_ip instance_name=minio1 get_instance_ip instance_name=minio1 http://localhost:None "GET /v1.46/containers/roottestscheduler-gw3-minio1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestscheduler-gw3-minio1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=proxy1 get_instance_ip instance_name=proxy1 http://localhost:None "GET /v1.46/containers/roottestscheduler-gw3-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestscheduler-gw3-proxy1-1/json HTTP/1.1" 200 None Starting new HTTP connection (1): 172.16.8.8:9001 Starting new HTTP connection (1): 172.16.8.8:9001 Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (2): 172.16.8.8:9001 Starting new HTTP connection (2): 172.16.8.8:9001 Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (3): 172.16.8.8:9001 Starting new HTTP connection (3): 172.16.8.8:9001 Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (4): 172.16.8.8:9001 Starting new HTTP connection (4): 172.16.8.8:9001 Can't connect to Minio: HTTPConnectionPool(host='172.16.8.8', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Can't connect to Minio: HTTPConnectionPool(host='172.16.8.8', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e513388ea821489701a51157c76024f281d1ff2052d1c2245942441eb78b6e8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e513388ea821489701a51157c76024f281d1ff2052d1c2245942441eb78b6e8/json HTTP/1.1" 200 None Executing query INSERT INTO postgres_database.test_data_types VALUES (9, -32768, -2147483648, -9223372036854775808, 1.12345, 1.1234567890, 2147483647, 9223372036854775807, '2000-05-12 12:12:12.012345', '2000-05-12', 0.2, 0.2) on instance Executing query INSERT INTO postgres_database.test_data_types VALUES (9, -32768, -2147483648, -9223372036854775808, 1.12345, 1.1234567890, 2147483647, 9223372036854775807, '2000-05-12 12:12:12.012345', '2000-05-12', 0.2, 0.2) on instance Executing query SELECT * FROM s3('http://minio1:9001/root/data/env_node_no_proxy/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on env_node_no_proxy Executing query SELECT * FROM s3('http://minio1:9001/root/data/env_node_no_proxy/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on env_node_no_proxy http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Executing query SELECT COUNT() FROM s3_low_cardinality WHERE not ignore(str_column) on node1 Executing query SELECT COUNT() FROM s3_low_cardinality WHERE not ignore(str_column) on node1 http://localhost:None "GET /v1.46/containers/2e513388ea821489701a51157c76024f281d1ff2052d1c2245942441eb78b6e8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e513388ea821489701a51157c76024f281d1ff2052d1c2245942441eb78b6e8/json HTTP/1.1" 200 None Executing query CREATE TABLE test_rename_distributed ON CLUSTER test_cluster AS test_rename_distributed_replicated ENGINE = Distributed(test_cluster, default, test_rename_distributed_replicated, rand()) on node1 Executing query CREATE TABLE test_rename_distributed ON CLUSTER test_cluster AS test_rename_distributed_replicated ENGINE = Distributed(test_cluster, default, test_rename_distributed_replicated, rand()) on node1 http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e513388ea821489701a51157c76024f281d1ff2052d1c2245942441eb78b6e8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e513388ea821489701a51157c76024f281d1ff2052d1c2245942441eb78b6e8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e513388ea821489701a51157c76024f281d1ff2052d1c2245942441eb78b6e8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e513388ea821489701a51157c76024f281d1ff2052d1c2245942441eb78b6e8/json HTTP/1.1" 200 None Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-proxy1-1 Running Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-proxy1-1 Running Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo1-1 Running Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo1-1 Running Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo3-1 Running Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo3-1 Running Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo2-1 Running Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo2-1 Running Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-proxy2-1 Running Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-proxy2-1 Running Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-minio1-1 Running Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-minio1-1 Running Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node1-1 Creating Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node1-1 Creating Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-resolver-1 Running Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-resolver-1 Running Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node3-1 Creating Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node3-1 Creating Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node2-1 Creating Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node2-1 Creating Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node3-1 Created Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node3-1 Created Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node1-1 Created Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node1-1 Created Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node2-1 Created Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node2-1 Created Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node2-1 Starting Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node2-1 Starting Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node1-1 Starting Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node1-1 Starting Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node3-1 Starting Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node3-1 Starting Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node1-1 Started Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node1-1 Started Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node3-1 Started Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node3-1 Started Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node2-1 Started Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node2-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node1 get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw5-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw5-node1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node1 get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw5-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw5-node1-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node1, ip: 172.16.6.10... Waiting for ClickHouse start in node1, ip: 172.16.6.10... http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw5-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw5-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e085f4b3c9f766d6a2ca7fc2cfb9069d03a08118fa85a4ae2904088e47fbe6b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e085f4b3c9f766d6a2ca7fc2cfb9069d03a08118fa85a4ae2904088e47fbe6b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e513388ea821489701a51157c76024f281d1ff2052d1c2245942441eb78b6e8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e513388ea821489701a51157c76024f281d1ff2052d1c2245942441eb78b6e8/json HTTP/1.1" 200 None Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Stopping Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Stopping Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Stopped Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Stopped Stopping zookeeper node: zoo2 Stopping zookeeper node: zoo2 Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo2] Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo2] http://localhost:None "GET /v1.46/containers/2e085f4b3c9f766d6a2ca7fc2cfb9069d03a08118fa85a4ae2904088e47fbe6b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e085f4b3c9f766d6a2ca7fc2cfb9069d03a08118fa85a4ae2904088e47fbe6b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Executing query SELECT * FROM `test_database`.`test_data_types` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`test_data_types` LIMIT 1 FORMAT Null on instance http://localhost:None "GET /v1.46/containers/2e513388ea821489701a51157c76024f281d1ff2052d1c2245942441eb78b6e8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e513388ea821489701a51157c76024f281d1ff2052d1c2245942441eb78b6e8/json HTTP/1.1" 200 None Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed (num,num2) SELECT number + 0 AS num, number + 1 + 0 AS num2 FROM numbers_mt(1000) on node1 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed (num,num2) SELECT number + 0 AS num, number + 1 + 0 AS num2 FROM numbers_mt(1000) on node1 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e085f4b3c9f766d6a2ca7fc2cfb9069d03a08118fa85a4ae2904088e47fbe6b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e085f4b3c9f766d6a2ca7fc2cfb9069d03a08118fa85a4ae2904088e47fbe6b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None [gw9] PASSED test_s3_low_cardinality_right_border/test.py::test_s3_right_border Executing query drop table if exists s3_low_cardinality on node1 Executing query drop table if exists s3_low_cardinality on node1 test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 http://localhost:None "GET /v1.46/containers/2e513388ea821489701a51157c76024f281d1ff2052d1c2245942441eb78b6e8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e513388ea821489701a51157c76024f281d1ff2052d1c2245942441eb78b6e8/json HTTP/1.1" 200 None ClickHouse node1 started ClickHouse node1 started get_instance_ip instance_name=node2 get_instance_ip instance_name=node2 http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-node2-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node2 get_instance_ip instance_name=node2 http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-node2-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node2, ip: 172.16.9.5... Waiting for ClickHouse start in node2, ip: 172.16.9.5... http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6ea47cd7ff8059ced076c910d3fef61686f4f1c041982f3434eab2cae2aca09f/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6ea47cd7ff8059ced076c910d3fef61686f4f1c041982f3434eab2cae2aca09f/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e085f4b3c9f766d6a2ca7fc2cfb9069d03a08118fa85a4ae2904088e47fbe6b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e085f4b3c9f766d6a2ca7fc2cfb9069d03a08118fa85a4ae2904088e47fbe6b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Executing query SHOW TABLES FROM `test_database` WHERE name = 'test_data_types' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'test_data_types' on instance http://localhost:None "GET /v1.46/containers/6ea47cd7ff8059ced076c910d3fef61686f4f1c041982f3434eab2cae2aca09f/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6ea47cd7ff8059ced076c910d3fef61686f4f1c041982f3434eab2cae2aca09f/json HTTP/1.1" 200 None ClickHouse node2 started ClickHouse node2 started Executing query CREATE FUNCTION f1 AS (x, y) -> x + y on node1 Executing query CREATE FUNCTION f1 AS (x, y) -> x + y on node1 Executing query create table s3_low_cardinality (key UInt32, str_column LowCardinality(String)) engine = MergeTree order by (key) settings storage_policy = 's3', min_bytes_for_wide_part = 0, index_granularity = 8192, min_compress_block_size=1, merge_max_block_size=10000 on node1 Executing query create table s3_low_cardinality (key UInt32, str_column LowCardinality(String)) engine = MergeTree order by (key) settings storage_policy = 's3', min_bytes_for_wide_part = 0, index_granularity = 8192, min_compress_block_size=1, merge_max_block_size=10000 on node1 http://localhost:None "GET /v1.46/containers/2e085f4b3c9f766d6a2ca7fc2cfb9069d03a08118fa85a4ae2904088e47fbe6b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e085f4b3c9f766d6a2ca7fc2cfb9069d03a08118fa85a4ae2904088e47fbe6b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] http://localhost:None "GET /v1.46/containers/2e085f4b3c9f766d6a2ca7fc2cfb9069d03a08118fa85a4ae2904088e47fbe6b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e085f4b3c9f766d6a2ca7fc2cfb9069d03a08118fa85a4ae2904088e47fbe6b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Executing query SELECT f1(12, 3) on node1 Executing query SELECT f1(12, 3) on node1 Executing query select * from `postgres_database`.`test_data_types` order by id; on instance Executing query select * from `postgres_database`.`test_data_types` order by id; on instance Starting new HTTP connection (5): 172.16.8.8:9001 Starting new HTTP connection (5): 172.16.8.8:9001 Stdout:757 Stdout:757 http://172.16.8.8:9001 "GET / HTTP/1.1" 200 0 http://172.16.8.8:9001 "GET / HTTP/1.1" 200 0 Connected to Minio. Connected to Minio. http://172.16.8.8:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.8.8:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.8.8:9001 "PUT /root HTTP/1.1" 200 0 http://172.16.8.8:9001 "PUT /root HTTP/1.1" 200 0 S3 bucket 'root' created S3 bucket 'root' created http://172.16.8.8:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.8.8:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.8.8:9001 "PUT /root2 HTTP/1.1" 200 0 http://172.16.8.8:9001 "PUT /root2 HTTP/1.1" 200 0 S3 bucket 'root2' created S3 bucket 'root2' created ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/.env --project-name roottestscheduler-gw3 --file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/node2/docker-compose.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/.env --project-name roottestscheduler-gw3 --file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/node2/docker-compose.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/.env --project-name roottestscheduler-gw3 --file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/node2/docker-compose.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/.env --project-name roottestscheduler-gw3 --file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/node2/docker-compose.yml up -d --no-recreate] http://localhost:None "GET /v1.46/containers/2e085f4b3c9f766d6a2ca7fc2cfb9069d03a08118fa85a4ae2904088e47fbe6b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e085f4b3c9f766d6a2ca7fc2cfb9069d03a08118fa85a4ae2904088e47fbe6b/json HTTP/1.1" 200 None Executing query insert into s3_low_cardinality select number, number % 8000 from numbers(8192) on node1 Executing query insert into s3_low_cardinality select number, number % 8000 from numbers(8192) on node1 http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e085f4b3c9f766d6a2ca7fc2cfb9069d03a08118fa85a4ae2904088e47fbe6b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e085f4b3c9f766d6a2ca7fc2cfb9069d03a08118fa85a4ae2904088e47fbe6b/json HTTP/1.1" 200 None Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Stopping Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Stopping Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Stopped Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Stopped Stopping zookeeper node: zoo3 Stopping zookeeper node: zoo3 Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo3] Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo3] http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Executing query select * from `test_database`.`test_data_types` order by id; on instance Executing query select * from `test_database`.`test_data_types` order by id; on instance http://localhost:None "GET /v1.46/containers/2e085f4b3c9f766d6a2ca7fc2cfb9069d03a08118fa85a4ae2904088e47fbe6b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e085f4b3c9f766d6a2ca7fc2cfb9069d03a08118fa85a4ae2904088e47fbe6b/json HTTP/1.1" 200 None Executing query DROP FUNCTION f1 on node1 Executing query DROP FUNCTION f1 on node1 http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Executing query insert into s3_low_cardinality select number = 0 ? 0 : (number + 8192 * 1), number % 8000 + 1 * 8192 from numbers(8192) on node1 Executing query insert into s3_low_cardinality select number = 0 ? 0 : (number + 8192 * 1), number % 8000 + 1 * 8192 from numbers(8192) on node1 http://localhost:None "GET /v1.46/containers/2e085f4b3c9f766d6a2ca7fc2cfb9069d03a08118fa85a4ae2904088e47fbe6b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e085f4b3c9f766d6a2ca7fc2cfb9069d03a08118fa85a4ae2904088e47fbe6b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e085f4b3c9f766d6a2ca7fc2cfb9069d03a08118fa85a4ae2904088e47fbe6b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e085f4b3c9f766d6a2ca7fc2cfb9069d03a08118fa85a4ae2904088e47fbe6b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None [gw2] PASSED test_replicated_user_defined_functions/test.py::test_create_and_drop test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[false-expected_raise1] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "echo '\n \n \n false\n \n \n' > /etc/clickhouse-server/users.d/users.xml"] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "echo '\n \n \n false\n \n \n' > /etc/clickhouse-server/users.d/users.xml"] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c echo ' false ' > /etc/clickhouse-server/users.d/users.xml] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c echo ' false ' > /etc/clickhouse-server/users.d/users.xml] http://localhost:None "GET /v1.46/containers/2e085f4b3c9f766d6a2ca7fc2cfb9069d03a08118fa85a4ae2904088e47fbe6b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e085f4b3c9f766d6a2ca7fc2cfb9069d03a08118fa85a4ae2904088e47fbe6b/json HTTP/1.1" 200 None Stderr: Container roottestscheduler-gw3-zoo2-1 Running Stderr: Container roottestscheduler-gw3-zoo2-1 Running Stderr: Container roottestscheduler-gw3-proxy2-1 Running Stderr: Container roottestscheduler-gw3-proxy2-1 Running Stderr: Container roottestscheduler-gw3-proxy1-1 Running Stderr: Container roottestscheduler-gw3-proxy1-1 Running Stderr: Container roottestscheduler-gw3-minio1-1 Running Stderr: Container roottestscheduler-gw3-minio1-1 Running Stderr: Container roottestscheduler-gw3-zoo3-1 Running Stderr: Container roottestscheduler-gw3-zoo3-1 Running Stderr: Container roottestscheduler-gw3-zoo1-1 Running Stderr: Container roottestscheduler-gw3-zoo1-1 Running Stderr: Container roottestscheduler-gw3-node2-1 Creating Stderr: Container roottestscheduler-gw3-node2-1 Creating Stderr: Container roottestscheduler-gw3-node-1 Creating Stderr: Container roottestscheduler-gw3-node-1 Creating Stderr: Container roottestscheduler-gw3-resolver-1 Running Stderr: Container roottestscheduler-gw3-resolver-1 Running Stderr: Container roottestscheduler-gw3-node-1 Created Stderr: Container roottestscheduler-gw3-node-1 Created Stderr: Container roottestscheduler-gw3-node2-1 Created Stderr: Container roottestscheduler-gw3-node2-1 Created Stderr: Container roottestscheduler-gw3-node2-1 Starting Stderr: Container roottestscheduler-gw3-node2-1 Starting Stderr: Container roottestscheduler-gw3-node-1 Starting Stderr: Container roottestscheduler-gw3-node-1 Starting Stderr: Container roottestscheduler-gw3-node2-1 Started Stderr: Container roottestscheduler-gw3-node2-1 Started Stderr: Container roottestscheduler-gw3-node-1 Started Stderr: Container roottestscheduler-gw3-node-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottestscheduler-gw3-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestscheduler-gw3-node-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottestscheduler-gw3-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestscheduler-gw3-node-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node, ip: 172.16.8.10... Waiting for ClickHouse start in node, ip: 172.16.8.10... http://localhost:None "GET /v1.46/containers/roottestscheduler-gw3-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestscheduler-gw3-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f55a9d42fa3411d78c2073aff7659e1986d4c86c67685a7bb8542de5f976be3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f55a9d42fa3411d78c2073aff7659e1986d4c86c67685a7bb8542de5f976be3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Executing query SYSTEM RELOAD CONFIG on node1 Executing query SYSTEM RELOAD CONFIG on node1 Executing query SELECT * FROM test_database.test_data_types ORDER BY id LIMIT 1; on instance Executing query SELECT * FROM test_database.test_data_types ORDER BY id LIMIT 1; on instance http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e085f4b3c9f766d6a2ca7fc2cfb9069d03a08118fa85a4ae2904088e47fbe6b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e085f4b3c9f766d6a2ca7fc2cfb9069d03a08118fa85a4ae2904088e47fbe6b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None Executing query insert into s3_low_cardinality select number = 0 ? 0 : (number + 8192 * 2), number % 8000 + 2 * 8192 from numbers(8192) on node1 Executing query insert into s3_low_cardinality select number = 0 ? 0 : (number + 8192 * 2), number % 8000 + 2 * 8192 from numbers(8192) on node1 http://localhost:None "GET /v1.46/containers/9f55a9d42fa3411d78c2073aff7659e1986d4c86c67685a7bb8542de5f976be3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f55a9d42fa3411d78c2073aff7659e1986d4c86c67685a7bb8542de5f976be3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e085f4b3c9f766d6a2ca7fc2cfb9069d03a08118fa85a4ae2904088e47fbe6b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e085f4b3c9f766d6a2ca7fc2cfb9069d03a08118fa85a4ae2904088e47fbe6b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f55a9d42fa3411d78c2073aff7659e1986d4c86c67685a7bb8542de5f976be3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f55a9d42fa3411d78c2073aff7659e1986d4c86c67685a7bb8542de5f976be3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Stopping Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Stopping Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Stopped Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Stopped Starting zookeeper node: zoo1 Starting zookeeper node: zoo1 Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo1] Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo1] http://localhost:None "GET /v1.46/containers/2e085f4b3c9f766d6a2ca7fc2cfb9069d03a08118fa85a4ae2904088e47fbe6b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2e085f4b3c9f766d6a2ca7fc2cfb9069d03a08118fa85a4ae2904088e47fbe6b/json HTTP/1.1" 200 None ClickHouse node1 started ClickHouse node1 started get_instance_ip instance_name=node2 get_instance_ip instance_name=node2 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw5-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw5-node2-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node2 get_instance_ip instance_name=node2 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw5-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw5-node2-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node2, ip: 172.16.6.9... Waiting for ClickHouse start in node2, ip: 172.16.6.9... http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw5-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw5-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6cce19c52f5fb1060685a546c3e856cc982fa6c6a3dbdebe109dd6b2d2094e40/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6cce19c52f5fb1060685a546c3e856cc982fa6c6a3dbdebe109dd6b2d2094e40/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f55a9d42fa3411d78c2073aff7659e1986d4c86c67685a7bb8542de5f976be3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f55a9d42fa3411d78c2073aff7659e1986d4c86c67685a7bb8542de5f976be3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Executing query CREATE FUNCTION f1 ON CLUSTER default AS (x, y) -> x + y on node1 Executing query CREATE FUNCTION f1 ON CLUSTER default AS (x, y) -> x + y on node1 Executing query SELECT * FROM `test_database`.`test_data_types` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`test_data_types` LIMIT 1 FORMAT Null on instance Executing query optimize table s3_low_cardinality final on node1 Executing query optimize table s3_low_cardinality final on node1 http://localhost:None "GET /v1.46/containers/6cce19c52f5fb1060685a546c3e856cc982fa6c6a3dbdebe109dd6b2d2094e40/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6cce19c52f5fb1060685a546c3e856cc982fa6c6a3dbdebe109dd6b2d2094e40/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f55a9d42fa3411d78c2073aff7659e1986d4c86c67685a7bb8542de5f976be3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f55a9d42fa3411d78c2073aff7659e1986d4c86c67685a7bb8542de5f976be3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:757 Stdout:757 http://localhost:None "GET /v1.46/containers/6cce19c52f5fb1060685a546c3e856cc982fa6c6a3dbdebe109dd6b2d2094e40/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6cce19c52f5fb1060685a546c3e856cc982fa6c6a3dbdebe109dd6b2d2094e40/json HTTP/1.1" 200 None ClickHouse node2 started ClickHouse node2 started get_instance_ip instance_name=node3 get_instance_ip instance_name=node3 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw5-node3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw5-node3-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node3 get_instance_ip instance_name=node3 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw5-node3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw5-node3-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node3, ip: 172.16.6.11... Waiting for ClickHouse start in node3, ip: 172.16.6.11... http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw5-node3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw5-node3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f55a9d42fa3411d78c2073aff7659e1986d4c86c67685a7bb8542de5f976be3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f55a9d42fa3411d78c2073aff7659e1986d4c86c67685a7bb8542de5f976be3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9b3749af8996c0d22ea358e2c60afba186c876b56070defb9dbbea1b5f689d30/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9b3749af8996c0d22ea358e2c60afba186c876b56070defb9dbbea1b5f689d30/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None ClickHouse node3 started ClickHouse node3 started Cluster started Cluster started run container_id:roottestreplicatedmergetrees3zerocopy-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicatedmergetrees3zerocopy-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicatedmergetrees3zerocopy-gw5-node1-1 bash -c ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicatedmergetrees3zerocopy-gw5-node1-1 bash -c ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] [gw2] PASSED test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[false-expected_raise1] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "echo '\n \n \n true\n \n \n' > /etc/clickhouse-server/users.d/users.xml"] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "echo '\n \n \n true\n \n \n' > /etc/clickhouse-server/users.d/users.xml"] test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[true-expected_raise0] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c echo ' true ' > /etc/clickhouse-server/users.d/users.xml] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c echo ' true ' > /etc/clickhouse-server/users.d/users.xml] Executing query SHOW TABLES FROM `test_database` WHERE name = 'test_data_types' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'test_data_types' on instance Stdout:1 Stdout:1 run container_id:roottestreplicatedmergetrees3zerocopy-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'kill -HUP 1'] run container_id:roottestreplicatedmergetrees3zerocopy-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'kill -HUP 1'] Command:[docker exec -u root roottestreplicatedmergetrees3zerocopy-gw5-node1-1 bash -c kill -HUP 1] Command:[docker exec -u root roottestreplicatedmergetrees3zerocopy-gw5-node1-1 bash -c kill -HUP 1] Executing query SYSTEM RELOAD CONFIG on node1 Executing query SYSTEM RELOAD CONFIG on node1 http://localhost:None "GET /v1.46/containers/9f55a9d42fa3411d78c2073aff7659e1986d4c86c67685a7bb8542de5f976be3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f55a9d42fa3411d78c2073aff7659e1986d4c86c67685a7bb8542de5f976be3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Starting Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Starting Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Started Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Started Starting zookeeper node: zoo2 Starting zookeeper node: zoo2 Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo2] Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo2] run container_id:roottestreplicatedmergetrees3zerocopy-gw5-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicatedmergetrees3zerocopy-gw5-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicatedmergetrees3zerocopy-gw5-node2-1 bash -c ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicatedmergetrees3zerocopy-gw5-node2-1 bash -c ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:1 Stdout:1 run container_id:roottestreplicatedmergetrees3zerocopy-gw5-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'kill -HUP 1'] run container_id:roottestreplicatedmergetrees3zerocopy-gw5-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'kill -HUP 1'] Command:[docker exec -u root roottestreplicatedmergetrees3zerocopy-gw5-node2-1 bash -c kill -HUP 1] Command:[docker exec -u root roottestreplicatedmergetrees3zerocopy-gw5-node2-1 bash -c kill -HUP 1] http://localhost:None "GET /v1.46/containers/9f55a9d42fa3411d78c2073aff7659e1986d4c86c67685a7bb8542de5f976be3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f55a9d42fa3411d78c2073aff7659e1986d4c86c67685a7bb8542de5f976be3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Executing query select name from system.zookeeper where path='/test/drop_table/replicas' on node1 Executing query select name from system.zookeeper where path='/test/drop_table/replicas' on node1 Executing query select * from s3_low_cardinality where key = 9000 on node1 Executing query select * from s3_low_cardinality where key = 9000 on node1 Executing query select * from `postgres_database`.`test_data_types` order by id; on instance Executing query select * from `postgres_database`.`test_data_types` order by id; on instance Executing query CREATE FUNCTION f1 ON CLUSTER default AS (x, y) -> x + y on node1 Executing query CREATE FUNCTION f1 ON CLUSTER default AS (x, y) -> x + y on node1 http://localhost:None "GET /v1.46/containers/9f55a9d42fa3411d78c2073aff7659e1986d4c86c67685a7bb8542de5f976be3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f55a9d42fa3411d78c2073aff7659e1986d4c86c67685a7bb8542de5f976be3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f55a9d42fa3411d78c2073aff7659e1986d4c86c67685a7bb8542de5f976be3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f55a9d42fa3411d78c2073aff7659e1986d4c86c67685a7bb8542de5f976be3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Starting Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Starting Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Started Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Started Starting zookeeper node: zoo3 Starting zookeeper node: zoo3 Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo3] Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo3] Executing query select name from system.zookeeper where path='/test/drop_table/replicas' on node2 Executing query select name from system.zookeeper where path='/test/drop_table/replicas' on node2 http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f55a9d42fa3411d78c2073aff7659e1986d4c86c67685a7bb8542de5f976be3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f55a9d42fa3411d78c2073aff7659e1986d4c86c67685a7bb8542de5f976be3/json HTTP/1.1" 200 None Executing query SELECT f1(12, 3) on node1 Executing query SELECT f1(12, 3) on node1 Executing query select * from `test_database`.`test_data_types` order by id; on instance Executing query select * from `test_database`.`test_data_types` order by id; on instance [gw9] PASSED test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 Executing query drop table if exists s3_low_cardinality on node1 Executing query drop table if exists s3_low_cardinality on node1 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f55a9d42fa3411d78c2073aff7659e1986d4c86c67685a7bb8542de5f976be3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f55a9d42fa3411d78c2073aff7659e1986d4c86c67685a7bb8542de5f976be3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f55a9d42fa3411d78c2073aff7659e1986d4c86c67685a7bb8542de5f976be3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f55a9d42fa3411d78c2073aff7659e1986d4c86c67685a7bb8542de5f976be3/json HTTP/1.1" 200 None Executing query create table test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3' on node1 Executing query create table test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3' on node1 Executing query DROP FUNCTION f1 ON CLUSTER default on node1 Executing query DROP FUNCTION f1 ON CLUSTER default on node1 http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f55a9d42fa3411d78c2073aff7659e1986d4c86c67685a7bb8542de5f976be3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f55a9d42fa3411d78c2073aff7659e1986d4c86c67685a7bb8542de5f976be3/json HTTP/1.1" 200 None Executing query create table s3_low_cardinality (x LowCardinality(String)) engine = MergeTree order by tuple() settings min_bytes_for_wide_part=0, storage_policy = 's3', max_compress_block_size=10000 on node1 Executing query create table s3_low_cardinality (x LowCardinality(String)) engine = MergeTree order by tuple() settings min_bytes_for_wide_part=0, storage_policy = 's3', max_compress_block_size=10000 on node1 Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Starting Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Starting Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Started Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Started get_instance_ip instance_name=zoo1 get_instance_ip instance_name=zoo1 http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw8-zoo1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw8-zoo1-1/json HTTP/1.1" 200 None get_kazoo_client: zoo1, ip:172.16.4.2, port:2281, use_ssl:True get_kazoo_client: zoo1, ip:172.16.4.2, port:2281, use_ssl:True Connecting to 172.16.4.2(172.16.4.2):2281, use_ssl: True Connecting to 172.16.4.2(172.16.4.2):2281, use_ssl: True Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f55a9d42fa3411d78c2073aff7659e1986d4c86c67685a7bb8542de5f976be3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f55a9d42fa3411d78c2073aff7659e1986d4c86c67685a7bb8542de5f976be3/json HTTP/1.1" 200 None Connecting to 172.16.4.2(172.16.4.2):2281, use_ssl: True Connecting to 172.16.4.2(172.16.4.2):2281, use_ssl: True Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query ALTER TABLE test_rename_distributed ON CLUSTER test_cluster RENAME COLUMN num2 to foo2 on node1 Executing query ALTER TABLE test_rename_distributed ON CLUSTER test_cluster RENAME COLUMN num2 to foo2 on node1 [gw2] PASSED test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[true-expected_raise0] Executing query CREATE FUNCTION f1 AS (x, y) -> x + y on node1 Executing query CREATE FUNCTION f1 AS (x, y) -> x + y on node1 test_replicated_user_defined_functions/test.py::test_create_and_replace run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f55a9d42fa3411d78c2073aff7659e1986d4c86c67685a7bb8542de5f976be3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f55a9d42fa3411d78c2073aff7659e1986d4c86c67685a7bb8542de5f976be3/json HTTP/1.1" 200 None Executing query create table test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '2') order by n partition by n % 99 settings storage_policy='s3' on node2 Executing query create table test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '2') order by n partition by n % 99 settings storage_policy='s3' on node2 Executing query insert into s3_low_cardinality select toString(number % 8000) || if(number < 8192 * 3, 'aaaaaaaaaaaaaaaa', if(number < 8192 * 6, 'bbbbbbbbbbbbbbbbbbbbbbbb', 'ccccccccccccccccccc')) from numbers(8192 * 9) on node1 Executing query insert into s3_low_cardinality select toString(number % 8000) || if(number < 8192 * 3, 'aaaaaaaaaaaaaaaa', if(number < 8192 * 6, 'bbbbbbbbbbbbbbbbbbbbbbbb', 'ccccccccccccccccccc')) from numbers(8192 * 9) on node1 No clickhouse process running. Start new one. No clickhouse process running. Start new one. http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw4-node-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw4-node-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/7592a35ee2aaee31673b6258a66530946c56bf6e17e5c97f321f4c5d5dc262a9/start HTTP/1.1" 200 0 http://localhost:None "POST /v1.46/exec/7592a35ee2aaee31673b6258a66530946c56bf6e17e5c97f321f4c5d5dc262a9/start HTTP/1.1" 200 0 http://localhost:None "GET /v1.46/exec/7592a35ee2aaee31673b6258a66530946c56bf6e17e5c97f321f4c5d5dc262a9/json HTTP/1.1" 200 586 http://localhost:None "GET /v1.46/exec/7592a35ee2aaee31673b6258a66530946c56bf6e17e5c97f321f4c5d5dc262a9/json HTTP/1.1" 200 586 http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f55a9d42fa3411d78c2073aff7659e1986d4c86c67685a7bb8542de5f976be3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f55a9d42fa3411d78c2073aff7659e1986d4c86c67685a7bb8542de5f976be3/json HTTP/1.1" 200 None ClickHouse node started ClickHouse node started get_instance_ip instance_name=node2 get_instance_ip instance_name=node2 http://localhost:None "GET /v1.46/containers/roottestscheduler-gw3-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestscheduler-gw3-node2-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node2 get_instance_ip instance_name=node2 http://localhost:None "GET /v1.46/containers/roottestscheduler-gw3-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestscheduler-gw3-node2-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node2, ip: 172.16.8.9... Waiting for ClickHouse start in node2, ip: 172.16.8.9... http://localhost:None "GET /v1.46/containers/roottestscheduler-gw3-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestscheduler-gw3-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/bf1c75dc37f8d5e536639503f3ca99ed1b6be7d40bebdd9e091f15f5e5e1a591/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/bf1c75dc37f8d5e536639503f3ca99ed1b6be7d40bebdd9e091f15f5e5e1a591/json HTTP/1.1" 200 None ClickHouse node2 started ClickHouse node2 started Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node Connecting to 172.16.4.2(172.16.4.2):2281, use_ssl: True Connecting to 172.16.4.2(172.16.4.2):2281, use_ssl: True Executing query SELECT f1(12, 3) on node1 Executing query SELECT f1(12, 3) on node1 http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Executing query ALTER TABLE test_rename_distributed_replicated ON CLUSTER test_cluster RENAME COLUMN num2 to foo2 on node1 Executing query ALTER TABLE test_rename_distributed_replicated ON CLUSTER test_cluster RENAME COLUMN num2 to foo2 on node1 http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Executing query insert into test_drop_table select * from numbers(1000) on node1 Executing query insert into test_drop_table select * from numbers(1000) on node1 run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] Executing query select uniq(x) from s3_low_cardinality settings max_threads=2, merge_tree_min_rows_for_concurrent_read_for_remote_filesystem=1, merge_tree_min_bytes_for_concurrent_read_for_remote_filesystem=1 on node1 Executing query select uniq(x) from s3_low_cardinality settings max_threads=2, merge_tree_min_rows_for_concurrent_read_for_remote_filesystem=1, merge_tree_min_bytes_for_concurrent_read_for_remote_filesystem=1 on node1 Executing query CREATE FUNCTION f1 AS (x, y) -> x + 2 * y on node1 Executing query CREATE FUNCTION f1 AS (x, y) -> x + 2 * y on node1 run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Executing query system reload config on node Executing query system reload config on node http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw9/.env --project-name roottests3lowcardinalityrightborder-gw9 --file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw9/.env --project-name roottests3lowcardinalityrightborder-gw9 --file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml stop --timeout 20] [gw9] PASSED test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 Executing query CREATE FUNCTION IF NOT EXISTS f1 AS (x, y) -> x + 3 * y on node1 Executing query CREATE FUNCTION IF NOT EXISTS f1 AS (x, y) -> x + 3 * y on node1 http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Executing query create resource io_write (write disk s3_no_resource); create resource io_read (read disk s3_no_resource); create workload all settings max_cost = 1000000 for io_write, max_cost = 2000000 for io_read; create workload admin in all settings priority = 0; create workload production in all settings priority = 1, weight = 9; create workload development in all settings priority = 1, weight = 1; on node Executing query create resource io_write (write disk s3_no_resource); create resource io_read (read disk s3_no_resource); create workload all settings max_cost = 1000000 for io_write, max_cost = 2000000 for io_read; create workload admin in all settings priority = 0; create workload production in all settings priority = 1, weight = 9; create workload development in all settings priority = 1, weight = 1; on node http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Executing query SELECT f1(12, 3) on node1 Executing query SELECT f1(12, 3) on node1 Executing query select * from `test_database`.`test_data_types` order by id; on instance Executing query select * from `test_database`.`test_data_types` order by id; on instance http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Executing query select count() from system.scheduler where path ilike '%/admin/%' and type='fifo' on node Executing query select count() from system.scheduler where path ilike '%/admin/%' and type='fifo' on node Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Connection dropped: socket connection broken Connection dropped: socket connection broken Executing query CREATE OR REPLACE FUNCTION f1 AS (x, y) -> x + 4 * y on node1 Executing query CREATE OR REPLACE FUNCTION f1 AS (x, y) -> x + 4 * y on node1 run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Executing query INSERT INTO postgres_database.test_array_data_type VALUES (0, ['2000-05-12', '2000-05-12'], ['2000-05-12 12:12:12.012345', '2000-05-12 12:12:12.012345'], [[1.12345], [1.12345], [1.12345]], [[1.1234567891], [1.1234567891], [1.1234567891]], [[[0.11111, 0.11111]], [[0.22222, 0.22222]], [[0.33333, 0.33333]]], [[[1, 1], [1, 1]], [[3, 3], [3, 3]], [[4, 4], [5, 5]]], [[[[['winx', 'winx', 'winx']]]]], [[[1, NULL], [NULL, 1]], [[NULL, NULL], [NULL, NULL]], [[4, 4], [5, 5]]], [[[[NULL]]]], []) on instance Executing query INSERT INTO postgres_database.test_array_data_type VALUES (0, ['2000-05-12', '2000-05-12'], ['2000-05-12 12:12:12.012345', '2000-05-12 12:12:12.012345'], [[1.12345], [1.12345], [1.12345]], [[1.1234567891], [1.1234567891], [1.1234567891]], [[[0.11111, 0.11111]], [[0.22222, 0.22222]], [[0.33333, 0.33333]]], [[[1, 1], [1, 1]], [[3, 3], [3, 3]], [[4, 4], [5, 5]]], [[[[['winx', 'winx', 'winx']]]]], [[[1, NULL], [NULL, 1]], [[NULL, NULL], [NULL, NULL]], [[4, 4], [5, 5]]], [[[[NULL]]]], []) on instance Stdout:1536 Stdout:1536 Clickhouse process running. Clickhouse process running. run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:1536 Stdout:1536 Executing query select 20 on node Executing query select 20 on node http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Executing query select count() from system.scheduler where path ilike '%/admin' and type='unified' and priority=0 on node Executing query select count() from system.scheduler where path ilike '%/admin' and type='unified' and priority=0 on node Executing query SELECT f1(12, 3) on node1 Executing query SELECT f1(12, 3) on node1 http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Executing query SELECT * FROM `test_database`.`test_array_data_type` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`test_array_data_type` LIMIT 1 FORMAT Null on instance Connecting to 172.16.4.2(172.16.4.2):2281, use_ssl: True Connecting to 172.16.4.2(172.16.4.2):2281, use_ssl: True Executing query DROP FUNCTION f1 on node1 Executing query DROP FUNCTION f1 on node1 http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Executing query select count() from system.scheduler where path ilike '%/production/%' and type='fifo' on node Executing query select count() from system.scheduler where path ilike '%/production/%' and type='fifo' on node Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Received response(xid=1): ['zookeeper', 'clickhouse'] Received response(xid=1): ['zookeeper', 'clickhouse'] Sending request(xid=2): Close() Sending request(xid=2): Close() Closing connection to 172.16.4.2:2281 Closing connection to 172.16.4.2:2281 Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo2 get_instance_ip instance_name=zoo2 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw8-zoo2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw8-zoo2-1/json HTTP/1.1" 200 None get_kazoo_client: zoo2, ip:172.16.4.3, port:2281, use_ssl:True get_kazoo_client: zoo2, ip:172.16.4.3, port:2281, use_ssl:True http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None Connecting to 172.16.4.3(172.16.4.3):2281, use_ssl: True Connecting to 172.16.4.3(172.16.4.3):2281, use_ssl: True http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None Executing query SHOW TABLES FROM `test_database` WHERE name = 'test_array_data_type' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'test_array_data_type' on instance http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Executing query CREATE FUNCTION f1 AS (x, y) -> x + y on node1 Executing query CREATE FUNCTION f1 AS (x, y) -> x + y on node1 [gw2] PASSED test_replicated_user_defined_functions/test.py::test_create_and_replace test_replicated_user_defined_functions/test.py::test_drop_if_exists Executing query select count() from system.scheduler where path ilike '%/production' and type='unified' and weight=9 on node Executing query select count() from system.scheduler where path ilike '%/production' and type='unified' and weight=9 on node http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Executing query select * from `postgres_database`.`test_array_data_type` order by key; on instance Executing query select * from `postgres_database`.`test_array_data_type` order by key; on instance Executing query DROP FUNCTION IF EXISTS f1 on node1 Executing query DROP FUNCTION IF EXISTS f1 on node1 http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Executing query select 20 on node Executing query select 20 on node Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['zookeeper', 'clickhouse'] Received response(xid=1): ['zookeeper', 'clickhouse'] Sending request(xid=2): Close() Sending request(xid=2): Close() Closing connection to 172.16.4.3:2281 Closing connection to 172.16.4.3:2281 Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo3 get_instance_ip instance_name=zoo3 http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw8-zoo3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw8-zoo3-1/json HTTP/1.1" 200 None get_kazoo_client: zoo3, ip:172.16.4.4, port:2281, use_ssl:True get_kazoo_client: zoo3, ip:172.16.4.4, port:2281, use_ssl:True Connecting to 172.16.4.4(172.16.4.4):2281, use_ssl: True Connecting to 172.16.4.4(172.16.4.4):2281, use_ssl: True http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Executing query select count() from system.scheduler where path ilike '%/development/%' and type='fifo' on node Executing query select count() from system.scheduler where path ilike '%/development/%' and type='fifo' on node Executing query DROP FUNCTION IF EXISTS f1 on node1 Executing query DROP FUNCTION IF EXISTS f1 on node1 Executing query select * from `test_database`.`test_array_data_type` order by key; on instance Executing query select * from `test_database`.`test_array_data_type` order by key; on instance http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Executing query DROP FUNCTION f1 on node1 Executing query DROP FUNCTION f1 on node1 http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Executing query select count() from system.scheduler where path ilike '%/all/%' and type='inflight_limit' and resource='io_write' and max_cost=1000000 on node Executing query select count() from system.scheduler where path ilike '%/all/%' and type='inflight_limit' and resource='io_write' and max_cost=1000000 on node http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Executing query SELECT * FROM test_database.test_array_data_type ORDER BY key; on instance Executing query SELECT * FROM test_database.test_array_data_type ORDER BY key; on instance http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None [gw2] PASSED test_replicated_user_defined_functions/test.py::test_drop_if_exists Executing query CREATE FUNCTION f1 AS (x, y) -> x + y on node1 Executing query CREATE FUNCTION f1 AS (x, y) -> x + y on node1 test_replicated_user_defined_functions/test.py::test_reload_zookeeper http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None Executing query select count() from system.scheduler where path ilike '%/all/%' and type='inflight_limit' and resource='io_read' and max_cost=2000000 on node Executing query select count() from system.scheduler where path ilike '%/all/%' and type='inflight_limit' and resource='io_read' and max_cost=2000000 on node Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query select 20 on node Executing query select 20 on node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/edb32e4fecda7b3d15c619cc2e1a2c975d546f43404e9cfc6333f162130e9bb1/json HTTP/1.1" 200 None ClickHouse node started ClickHouse node started http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None Executing query CREATE TABLE distributed (id UInt32) ENGINE = Distributed('test_cluster', 'default', 'replicated') on node Executing query CREATE TABLE distributed (id UInt32) ENGINE = Distributed('test_cluster', 'default', 'replicated') on node Executing query SELECT name FROM system.functions WHERE name ='f1' on node2 Executing query SELECT name FROM system.functions WHERE name ='f1' on node2 run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] Command:[docker exec -u root roottestscheduler-gw3-node-1 bash -c ps -C clickhouse] Command:[docker exec -u root roottestscheduler-gw3-node-1 bash -c ps -C clickhouse] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/num_levels/no_such_column_family_option/g' /etc/clickhouse-server/config.d/rocksdb.xml"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/num_levels/no_such_column_family_option/g' /etc/clickhouse-server/config.d/rocksdb.xml"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c sed -i 's/num_levels/no_such_column_family_option/g' /etc/clickhouse-server/config.d/rocksdb.xml] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c sed -i 's/num_levels/no_such_column_family_option/g' /etc/clickhouse-server/config.d/rocksdb.xml] [gw4] PASSED test_rocksdb_options/test.py::test_invalid_block_based_table_options test_rocksdb_options/test.py::test_invalid_column_family_options Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['zookeeper', 'clickhouse'] Received response(xid=1): ['zookeeper', 'clickhouse'] Sending request(xid=2): Close() Sending request(xid=2): Close() Stdout: PID TTY TIME CMD Stdout: PID TTY TIME CMD Stdout: 8 ? 00:00:01 clickhouse Stdout: 8 ? 00:00:01 clickhouse Closing connection to 172.16.4.4:2281 Closing connection to 172.16.4.4:2281 run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] Command:[docker exec -u root roottestscheduler-gw3-node-1 bash -c pkill clickhouse] Command:[docker exec -u root roottestscheduler-gw3-node-1 bash -c pkill clickhouse] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED All instances of ZooKeeper started: ['zoo1', 'zoo2', 'zoo3'] All instances of ZooKeeper started: ['zoo1', 'zoo2', 'zoo3'] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c ps -C clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c ps -C clickhouse] run container_id:roottestreloadclientcertificate-gw8-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo -n > /var/log/clickhouse-server/clickhouse-server.log'] run container_id:roottestreloadclientcertificate-gw8-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo -n > /var/log/clickhouse-server/clickhouse-server.log'] Command:[docker exec roottestreloadclientcertificate-gw8-node1-1 bash -c echo -n > /var/log/clickhouse-server/clickhouse-server.log] Command:[docker exec roottestreloadclientcertificate-gw8-node1-1 bash -c echo -n > /var/log/clickhouse-server/clickhouse-server.log] Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance [gw1] PASSED test_postgresql_replica_database_engine_1/test.py::test_different_data_types Executing query CREATE TABLE distributed2 (id UInt32) ENGINE = Distributed('test_cluster2', 'default', 'replicated') on node Executing query CREATE TABLE distributed2 (id UInt32) ENGINE = Distributed('test_cluster2', 'default', 'replicated') on node run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestscheduler-gw3-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestscheduler-gw3-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout: PID TTY TIME CMD Stdout: PID TTY TIME CMD Stdout: 1536 ? 00:00:01 clickhouse Stdout: 1536 ? 00:00:01 clickhouse run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c pkill clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c pkill clickhouse] run container_id:roottestreloadclientcertificate-gw8-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo -n > /var/log/clickhouse-server/clickhouse-server.log'] run container_id:roottestreloadclientcertificate-gw8-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo -n > /var/log/clickhouse-server/clickhouse-server.log'] Command:[docker exec roottestreloadclientcertificate-gw8-node2-1 bash -c echo -n > /var/log/clickhouse-server/clickhouse-server.log] Command:[docker exec roottestreloadclientcertificate-gw8-node2-1 bash -c echo -n > /var/log/clickhouse-server/clickhouse-server.log] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo \'\n \n \n zoo1\n 2181\n \n 2000\n \n\' > /etc/clickhouse-server/conf.d/zookeeper.xml'] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo \'\n \n \n zoo1\n 2181\n \n 2000\n \n\' > /etc/clickhouse-server/conf.d/zookeeper.xml'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c echo ' zoo1 2181 2000 ' > /etc/clickhouse-server/conf.d/zookeeper.xml] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c echo ' zoo1 2181 2000 ' > /etc/clickhouse-server/conf.d/zookeeper.xml] Stdout:8 Stdout:8 run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] run container_id:roottestreloadclientcertificate-gw8-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF\n\n \n \n /etc/clickhouse-server/config.d/third_client.crt\n /etc/clickhouse-server/config.d/third_client.key\n true\n true\n sslv2,sslv3\n true\n none\n \n RejectCertificateHandler\n \n \n \n\nEOF'] run container_id:roottestreloadclientcertificate-gw8-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF\n\n \n \n /etc/clickhouse-server/config.d/third_client.crt\n /etc/clickhouse-server/config.d/third_client.key\n true\n true\n sslv2,sslv3\n true\n none\n \n RejectCertificateHandler\n \n \n \n\nEOF'] Command:[docker exec roottestreloadclientcertificate-gw8-node1-1 bash -c cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF /etc/clickhouse-server/config.d/third_client.crt /etc/clickhouse-server/config.d/third_client.key true true sslv2,sslv3 true none RejectCertificateHandler EOF] Command:[docker exec roottestreloadclientcertificate-gw8-node1-1 bash -c cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF /etc/clickhouse-server/config.d/third_client.crt /etc/clickhouse-server/config.d/third_client.key true true sslv2,sslv3 true none RejectCertificateHandler EOF] Executing query SYSTEM RELOAD CONFIG on node1 Executing query SYSTEM RELOAD CONFIG on node1 Stdout:1536 Stdout:1536 Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node run container_id:roottestreloadclientcertificate-gw8-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'touch /etc/clickhouse-server/config.d/ssl_conf.xml'] run container_id:roottestreloadclientcertificate-gw8-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'touch /etc/clickhouse-server/config.d/ssl_conf.xml'] Command:[docker exec roottestreloadclientcertificate-gw8-node1-1 bash -c touch /etc/clickhouse-server/config.d/ssl_conf.xml] Command:[docker exec roottestreloadclientcertificate-gw8-node1-1 bash -c touch /etc/clickhouse-server/config.d/ssl_conf.xml] Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance run container_id:roottestreloadclientcertificate-gw8-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF\n\n \n \n /etc/clickhouse-server/config.d/third_client.crt\n /etc/clickhouse-server/config.d/third_client.key\n true\n true\n sslv2,sslv3\n true\n none\n \n RejectCertificateHandler\n \n \n \n\nEOF'] run container_id:roottestreloadclientcertificate-gw8-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF\n\n \n \n /etc/clickhouse-server/config.d/third_client.crt\n /etc/clickhouse-server/config.d/third_client.key\n true\n true\n sslv2,sslv3\n true\n none\n \n RejectCertificateHandler\n \n \n \n\nEOF'] Command:[docker exec roottestreloadclientcertificate-gw8-node2-1 bash -c cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF /etc/clickhouse-server/config.d/third_client.crt /etc/clickhouse-server/config.d/third_client.key true true sslv2,sslv3 true none RejectCertificateHandler EOF] Command:[docker exec roottestreloadclientcertificate-gw8-node2-1 bash -c cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF /etc/clickhouse-server/config.d/third_client.crt /etc/clickhouse-server/config.d/third_client.key true true sslv2,sslv3 true none RejectCertificateHandler EOF] run container_id:roottestreloadclientcertificate-gw8-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'touch /etc/clickhouse-server/config.d/ssl_conf.xml'] run container_id:roottestreloadclientcertificate-gw8-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'touch /etc/clickhouse-server/config.d/ssl_conf.xml'] Command:[docker exec roottestreloadclientcertificate-gw8-node2-1 bash -c touch /etc/clickhouse-server/config.d/ssl_conf.xml] Command:[docker exec roottestreloadclientcertificate-gw8-node2-1 bash -c touch /etc/clickhouse-server/config.d/ssl_conf.xml] run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo \'\n \n \n zoo1\n 2181\n \n 2000\n \n\' > /etc/clickhouse-server/conf.d/zookeeper.xml'] run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo \'\n \n \n zoo1\n 2181\n \n 2000\n \n\' > /etc/clickhouse-server/conf.d/zookeeper.xml'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c echo ' zoo1 2181 2000 ' > /etc/clickhouse-server/conf.d/zookeeper.xml] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c echo ' zoo1 2181 2000 ' > /etc/clickhouse-server/conf.d/zookeeper.xml] Executing query SYSTEM RELOAD CONFIG on node2 Executing query SYSTEM RELOAD CONFIG on node2 Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished Executing query INSERT INTO `postgres_database`.postgresql_replica_0 SELECT number, number from numbers(100000) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_0 SELECT number, number from numbers(100000) on instance Executing query CREATE FUNCTION f2 AS () -> (SELECT sum(s) FROM (SELECT 1 as s UNION ALL SELECT 1 as s)) on node1 Executing query CREATE FUNCTION f2 AS () -> (SELECT sum(s) FROM (SELECT 1 as s UNION ALL SELECT 1 as s)) on node1 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None Executing query SELECT name FROM system.functions WHERE name IN ['f1', 'f2'] ORDER BY name on node2 Executing query SELECT name FROM system.functions WHERE name IN ['f1', 'f2'] ORDER BY name on node2 run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestscheduler-gw3-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestscheduler-gw3-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:8 Stdout:8 run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stopping zookeeper node: zoo1 Stopping zookeeper node: zoo1 Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop zoo1] Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop zoo1] Stdout:1536 Stdout:1536 Executing query INSERT INTO `postgres_database`.postgresql_replica_1 SELECT number, number from numbers(100000) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_1 SELECT number, number from numbers(100000) on instance http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None Executing query INSERT INTO `postgres_database`.postgresql_replica_2 SELECT number, number from numbers(100000) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_2 SELECT number, number from numbers(100000) on instance run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestscheduler-gw3-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestscheduler-gw3-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:8 Stdout:8 run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:1536 Stdout:1536 Executing query INSERT INTO `postgres_database`.postgresql_replica_3 SELECT number, number from numbers(100000) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_3 SELECT number, number from numbers(100000) on instance http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed (num,foo2) SELECT number + 0 AS num, number + 1 + 0 AS foo2 FROM numbers_mt(1000) on node1 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed (num,foo2) SELECT number + 0 AS num, number + 1 + 0 AS foo2 FROM numbers_mt(1000) on node1 Executing query INSERT INTO `postgres_database`.postgresql_replica_4 SELECT number, number from numbers(100000) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_4 SELECT number, number from numbers(100000) on instance run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestscheduler-gw3-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestscheduler-gw3-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:8 Stdout:8 run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] No clickhouse process running. Start new one. No clickhouse process running. Start new one. http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw4-node-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw4-node-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/8ad11afa56b6aeb18c58b38669e505e99a0c1bce7bf14305ac7396020c975409/start HTTP/1.1" 200 0 http://localhost:None "POST /v1.46/exec/8ad11afa56b6aeb18c58b38669e505e99a0c1bce7bf14305ac7396020c975409/start HTTP/1.1" 200 0 http://localhost:None "GET /v1.46/exec/8ad11afa56b6aeb18c58b38669e505e99a0c1bce7bf14305ac7396020c975409/json HTTP/1.1" 200 586 http://localhost:None "GET /v1.46/exec/8ad11afa56b6aeb18c58b38669e505e99a0c1bce7bf14305ac7396020c975409/json HTTP/1.1" 200 586 Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query DROP DATABASE IF EXISTS `test_database` on instance http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query SHOW DATABASES on instance Executing query SHOW DATABASES on instance run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestscheduler-gw3-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestscheduler-gw3-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestscheduler-gw3-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestscheduler-gw3-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] No clickhouse process running. Start new one. No clickhouse process running. Start new one. http://localhost:None "POST /v1.46/containers/roottestscheduler-gw3-node-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/roottestscheduler-gw3-node-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/d1806531aa7dedfe39346ae057e79fd9865459d02c4bdfc45821d8b99e88d60e/start HTTP/1.1" 200 0 http://localhost:None "POST /v1.46/exec/d1806531aa7dedfe39346ae057e79fd9865459d02c4bdfc45821d8b99e88d60e/start HTTP/1.1" 200 0 http://localhost:None "GET /v1.46/exec/d1806531aa7dedfe39346ae057e79fd9865459d02c4bdfc45821d8b99e88d60e/json HTTP/1.1" 200 586 http://localhost:None "GET /v1.46/exec/d1806531aa7dedfe39346ae057e79fd9865459d02c4bdfc45821d8b99e88d60e/json HTTP/1.1" 200 586 run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:2315 Stdout:2315 Clickhouse process running. Clickhouse process running. run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:2315 Stdout:2315 Executing query select 20 on node Executing query select 20 on node [gw6] PASSED test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_no_proxy Executing query INSERT INTO FUNCTION s3('http://minio1:9001/root/data/env_node/test.csv', 'minio', 'minio123', 'CSV', 'key String, value String') VALUES ('color','red'),('size','10') on env_node Executing query INSERT INTO FUNCTION s3('http://minio1:9001/root/data/env_node/test.csv', 'minio', 'minio123', 'CSV', 'key String, value String') VALUES ('color','red'),('size','10') on env_node test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_proxy Executing query SELECT * FROM s3('http://minio1:9001/root/data/env_node/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on env_node Executing query SELECT * FROM s3('http://minio1:9001/root/data/env_node/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on env_node run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestscheduler-gw3-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestscheduler-gw3-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:803 Stdout:803 Clickhouse process running. Clickhouse process running. run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestscheduler-gw3-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestscheduler-gw3-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query select 20 on node Executing query select 20 on node Stdout:803 Stdout:803 Executing query select 20 on node Executing query select 20 on node Executing query SELECT * FROM s3('http://minio1:9001/root/data/env_node/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on env_node Executing query SELECT * FROM s3('http://minio1:9001/root/data/env_node/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on env_node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None Executing query SELECT count() FROM test_rename_distributed WHERE foo2 % 1000 > 0 on node1 Executing query SELECT count() FROM test_rename_distributed WHERE foo2 % 1000 > 0 on node1 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query select 20 on node Executing query select 20 on node Executing query select 20 on node Executing query select 20 on node Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query SHOW DATABASES on instance Executing query SHOW DATABASES on instance http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None Executing query select 20 on node Executing query select 20 on node Executing query select 20 on node Executing query select 20 on node Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB PRIMARY KEY(key); on node Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB PRIMARY KEY(key); on node Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Stopped Stopping zookeeper node: zoo2 Stopping zookeeper node: zoo2 Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop zoo2] Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop zoo2] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/no_such_column_family_option/num_levels/g' /etc/clickhouse-server/config.d/rocksdb.xml"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/no_such_column_family_option/num_levels/g' /etc/clickhouse-server/config.d/rocksdb.xml"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c sed -i 's/no_such_column_family_option/num_levels/g' /etc/clickhouse-server/config.d/rocksdb.xml] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c sed -i 's/no_such_column_family_option/num_levels/g' /etc/clickhouse-server/config.d/rocksdb.xml] Executing query SELECT count() FROM test_rename_distributed WHERE foo2 % 1000 > 0 on node1 Executing query SELECT count() FROM test_rename_distributed WHERE foo2 % 1000 > 0 on node1 Executing query select 20 on node Executing query select 20 on node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c ps -C clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c ps -C clickhouse] http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None Stdout: PID TTY TIME CMD Stdout: PID TTY TIME CMD Stdout: 2315 ? 00:00:03 clickhouse Stdout: 2315 ? 00:00:03 clickhouse run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c pkill clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c pkill clickhouse] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query select count() from system.scheduler where path ilike '%/admin/%' and type='fifo' on node Executing query select count() from system.scheduler where path ilike '%/admin/%' and type='fifo' on node Stdout:2315 Stdout:2315 Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query system sync replica test_drop_table on node2 Executing query system sync replica test_drop_table on node2 Executing query select count() from system.scheduler where path ilike '%/admin' and type='unified' and priority=0 on node Executing query select count() from system.scheduler where path ilike '%/admin' and type='unified' and priority=0 on node Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Executing query select count() from system.scheduler where path ilike '%/production/%' and type='fifo' on node Executing query select count() from system.scheduler where path ilike '%/production/%' and type='fifo' on node Executing query SHOW DATABASES on instance Executing query SHOW DATABASES on instance http://localhost:None "POST /v1.46/containers/create HTTP/1.1" 201 88 http://localhost:None "POST /v1.46/containers/create HTTP/1.1" 201 88 http://localhost:None "GET /v1.46/containers/dcbbb908b79f8e8f15fe94c778a087e5d97f5754f2e06fdf0feefad1176307e6/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/dcbbb908b79f8e8f15fe94c778a087e5d97f5754f2e06fdf0feefad1176307e6/json HTTP/1.1" 200 None Executing query SELECT count() FROM test_rename_distributed WHERE foo2 % 1000 > 0 on node1 Executing query SELECT count() FROM test_rename_distributed WHERE foo2 % 1000 > 0 on node1 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "POST /v1.46/containers/dcbbb908b79f8e8f15fe94c778a087e5d97f5754f2e06fdf0feefad1176307e6/start HTTP/1.1" 204 0 http://localhost:None "POST /v1.46/containers/dcbbb908b79f8e8f15fe94c778a087e5d97f5754f2e06fdf0feefad1176307e6/start HTTP/1.1" 204 0 [network] Created new container dcbbb908b79f8e8f15fe94c778a087e5d97f5754f2e06fdf0feefad1176307e6 [network] Created new container dcbbb908b79f8e8f15fe94c778a087e5d97f5754f2e06fdf0feefad1176307e6 Executing query select count() from system.scheduler where path ilike '%/production' and type='unified' and weight=9 on node Executing query select count() from system.scheduler where path ilike '%/production' and type='unified' and weight=9 on node http://localhost:None "POST /v1.46/containers/dcbbb908b79f8e8f15fe94c778a087e5d97f5754f2e06fdf0feefad1176307e6/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/dcbbb908b79f8e8f15fe94c778a087e5d97f5754f2e06fdf0feefad1176307e6/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/ed571cf680cd0e64604584a141ddae72f160199ff387a07c8d508606c5d1a43a/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/ed571cf680cd0e64604584a141ddae72f160199ff387a07c8d508606c5d1a43a/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/exec/ed571cf680cd0e64604584a141ddae72f160199ff387a07c8d508606c5d1a43a/json HTTP/1.1" 200 549 http://localhost:None "GET /v1.46/exec/ed571cf680cd0e64604584a141ddae72f160199ff387a07c8d508606c5d1a43a/json HTTP/1.1" 200 549 [network] dcbbb908b79f8e8f15fe94c778a087e5d97f5754f2e06fdf0feefad1176307e6: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-m', 'statistic', '--mode', 'random', '--probability', '0.01', '-p', 'tcp', '-d', '172.16.6.10', '--sport', '2181', '-j', 'REJECT', '--reject-with', 'tcp-reset'] (0): [network] dcbbb908b79f8e8f15fe94c778a087e5d97f5754f2e06fdf0feefad1176307e6: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-m', 'statistic', '--mode', 'random', '--probability', '0.01', '-p', 'tcp', '-d', '172.16.6.10', '--sport', '2181', '-j', 'REJECT', '--reject-with', 'tcp-reset'] (0): http://localhost:None "POST /v1.46/containers/dcbbb908b79f8e8f15fe94c778a087e5d97f5754f2e06fdf0feefad1176307e6/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/dcbbb908b79f8e8f15fe94c778a087e5d97f5754f2e06fdf0feefad1176307e6/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/24fa844ae6eef96c1568db78007c6e6861eb90aaf5692d94ccf542e61548418d/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/24fa844ae6eef96c1568db78007c6e6861eb90aaf5692d94ccf542e61548418d/start HTTP/1.1" 101 0 run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] http://localhost:None "GET /v1.46/exec/24fa844ae6eef96c1568db78007c6e6861eb90aaf5692d94ccf542e61548418d/json HTTP/1.1" 200 549 http://localhost:None "GET /v1.46/exec/24fa844ae6eef96c1568db78007c6e6861eb90aaf5692d94ccf542e61548418d/json HTTP/1.1" 200 549 [network] dcbbb908b79f8e8f15fe94c778a087e5d97f5754f2e06fdf0feefad1176307e6: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-m', 'statistic', '--mode', 'random', '--probability', '0.01', '-p', 'tcp', '-s', '172.16.6.10', '--dport', '2181', '-j', 'REJECT', '--reject-with', 'tcp-reset'] (0): [network] dcbbb908b79f8e8f15fe94c778a087e5d97f5754f2e06fdf0feefad1176307e6: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-m', 'statistic', '--mode', 'random', '--probability', '0.01', '-p', 'tcp', '-s', '172.16.6.10', '--dport', '2181', '-j', 'REJECT', '--reject-with', 'tcp-reset'] (0): Executing query drop table test_drop_table on node1 Executing query drop table test_drop_table on node1 Stdout:2315 Stdout:2315 Executing query select count() from system.scheduler where path ilike '%/development/%' and type='fifo' on node Executing query select count() from system.scheduler where path ilike '%/development/%' and type='fifo' on node Executing query select count() from system.scheduler where path ilike '%/all/%' and type='inflight_limit' and resource='io_write' and max_cost=1000000 on node Executing query select count() from system.scheduler where path ilike '%/all/%' and type='inflight_limit' and resource='io_write' and max_cost=1000000 on node Executing query SELECT count() FROM test_rename_distributed WHERE foo2 % 1000 > 0 on node1 Executing query SELECT count() FROM test_rename_distributed WHERE foo2 % 1000 > 0 on node1 Executing query select count() from system.scheduler where path ilike '%/all/%' and type='inflight_limit' and resource='io_read' and max_cost=2000000 on node Executing query select count() from system.scheduler where path ilike '%/all/%' and type='inflight_limit' and resource='io_read' and max_cost=2000000 on node Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None grep in log called Reloaded certificate (/etc/clickhouse-server/config.d/third_client.crt) grep in log called Reloaded certificate (/etc/clickhouse-server/config.d/third_client.crt) run container_id:roottestreloadclientcertificate-gw8-node1-1 detach:False nothrow:False cmd: ['bash', '-c', '[ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -a "Reloaded certificate (/etc/clickhouse-server/config.d/third_client.crt)" /var/log/clickhouse-server/clickhouse-server.log* || true'] run container_id:roottestreloadclientcertificate-gw8-node1-1 detach:False nothrow:False cmd: ['bash', '-c', '[ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -a "Reloaded certificate (/etc/clickhouse-server/config.d/third_client.crt)" /var/log/clickhouse-server/clickhouse-server.log* || true'] Command:[docker exec roottestreloadclientcertificate-gw8-node1-1 bash -c [ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -a "Reloaded certificate (/etc/clickhouse-server/config.d/third_client.crt)" /var/log/clickhouse-server/clickhouse-server.log* || true] Command:[docker exec roottestreloadclientcertificate-gw8-node1-1 bash -c [ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -a "Reloaded certificate (/etc/clickhouse-server/config.d/third_client.crt)" /var/log/clickhouse-server/clickhouse-server.log* || true] Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Stdout:2025.04.02 02:53:03.187359 [ 664 ] {} CertificateReloader: Reloaded certificate (/etc/clickhouse-server/config.d/third_client.crt) and key (/etc/clickhouse-server/config.d/third_client.key). Stdout:2025.04.02 02:53:03.187359 [ 664 ] {} CertificateReloader: Reloaded certificate (/etc/clickhouse-server/config.d/third_client.crt) and key (/etc/clickhouse-server/config.d/third_client.key). grep result 2025.04.02 02:53:03.187359 [ 664 ] {} CertificateReloader: Reloaded certificate (/etc/clickhouse-server/config.d/third_client.crt) and key (/etc/clickhouse-server/config.d/third_client.key). grep result 2025.04.02 02:53:03.187359 [ 664 ] {} CertificateReloader: Reloaded certificate (/etc/clickhouse-server/config.d/third_client.crt) and key (/etc/clickhouse-server/config.d/third_client.key). Stopping zookeeper node: zoo1 Stopping zookeeper node: zoo1 Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo1] Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo1] [gw3] PASSED test_scheduler/test.py::test_create_workload test_scheduler/test.py::test_merge_workload Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:2315 Stdout:2315 Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query SELECT count() FROM test_rename_distributed WHERE foo2 % 1000 > 0 on node1 Executing query SELECT count() FROM test_rename_distributed WHERE foo2 % 1000 > 0 on node1 run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query system reload config on node Executing query system reload config on node Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query SELECT count() FROM test_rename_distributed WHERE foo2 % 1000 > 0 on node1 Executing query SELECT count() FROM test_rename_distributed WHERE foo2 % 1000 > 0 on node1 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None Executing query drop table if exists data; create table data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3'; on node Executing query drop table if exists data; create table data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3'; on node run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:2315 Stdout:2315 Executing query SHOW DATABASES on instance Executing query SHOW DATABASES on instance Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Stopping Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Stopping Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Stopped Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Stopped Stopping zookeeper node: zoo2 Stopping zookeeper node: zoo2 Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo2] Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo2] Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/sys/merges' on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/sys/merges' on node Executing query DROP TABLE IF EXISTS test_rename_distributed ON CLUSTER test_cluster SYNC on node1 Executing query DROP TABLE IF EXISTS test_rename_distributed ON CLUSTER test_cluster SYNC on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/sys/merges' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/sys/merges' on node Executing query insert into data select * from numbers(1e4) on node Executing query insert into data select * from numbers(1e4) on node Executing query DROP TABLE IF EXISTS test_rename_distributed_replicated ON CLUSTER test_cluster SYNC on node1 Executing query DROP TABLE IF EXISTS test_rename_distributed_replicated ON CLUSTER test_cluster SYNC on node1 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Stopping Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Stopping Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Stopped Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Stopped Stopping zookeeper node: zoo3 Stopping zookeeper node: zoo3 Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo3] Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo3] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query insert into data select * from numbers(2e4) on node Executing query insert into data select * from numbers(2e4) on node No clickhouse process running. Start new one. No clickhouse process running. Start new one. http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw4-node-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw4-node-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/5744989681bb7b303241deb13891347bbadb315a4a9be26b3e4481f7a480acd6/start HTTP/1.1" 200 0 http://localhost:None "POST /v1.46/exec/5744989681bb7b303241deb13891347bbadb315a4a9be26b3e4481f7a480acd6/start HTTP/1.1" 200 0 http://localhost:None "GET /v1.46/exec/5744989681bb7b303241deb13891347bbadb315a4a9be26b3e4481f7a480acd6/json HTTP/1.1" 200 586 http://localhost:None "GET /v1.46/exec/5744989681bb7b303241deb13891347bbadb315a4a9be26b3e4481f7a480acd6/json HTTP/1.1" 200 586 Executing query insert into data select * from numbers(3e4) on node Executing query insert into data select * from numbers(3e4) on node Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query optimize table data final on node Executing query optimize table data final on node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Stopping Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Stopping Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Stopped Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Stopped Starting zookeeper node: zoo1 Starting zookeeper node: zoo1 Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo1] Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo1] Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/sys/merges' on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/sys/merges' on node run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Stdout:3105 Stdout:3105 Clickhouse process running. Clickhouse process running. run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:3105 Stdout:3105 Executing query select 20 on node Executing query select 20 on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/sys/merges' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/sys/merges' on node Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Starting Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Starting Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Started Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Started Starting zookeeper node: zoo2 Starting zookeeper node: zoo2 Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo2] Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo2] Executing query SHOW DATABASES on instance Executing query SHOW DATABASES on instance [gw0] PASSED test_rename_column/test.py::test_rename_distributed test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select Executing query CREATE TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster ( num UInt32, num2 UInt32 DEFAULT num + 1 ) ENGINE = ReplicatedMergeTree('/clickhouse/tables/test/{shard}/test_rename_distributed_parallel_insert_and_select_replicated', '{replica}') ORDER BY num PARTITION BY num % 100; on node1 Executing query CREATE TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster ( num UInt32, num2 UInt32 DEFAULT num + 1 ) ENGINE = ReplicatedMergeTree('/clickhouse/tables/test/{shard}/test_rename_distributed_parallel_insert_and_select_replicated', '{replica}') ORDER BY num PARTITION BY num % 100; on node1 [gw3] PASSED test_scheduler/test.py::test_merge_workload test_scheduler/test.py::test_merge_workload_change Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Starting Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Starting Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Started Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Started Starting zookeeper node: zoo3 Starting zookeeper node: zoo3 Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo3] Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo3] http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Executing query system reload config on node Executing query system reload config on node Executing query CREATE TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster AS test_rename_distributed_parallel_insert_and_select_replicated ENGINE = Distributed(test_cluster, default, test_rename_distributed_parallel_insert_and_select_replicated, rand()) on node1 Executing query CREATE TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster AS test_rename_distributed_parallel_insert_and_select_replicated ENGINE = Distributed(test_cluster, default, test_rename_distributed_parallel_insert_and_select_replicated, rand()) on node1 Executing query select 20 on node Executing query select 20 on node Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Starting Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Starting Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Started Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Started run container_id:roottestreloadclientcertificate-gw8-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo -n > /var/log/clickhouse-server/clickhouse-server.log'] run container_id:roottestreloadclientcertificate-gw8-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo -n > /var/log/clickhouse-server/clickhouse-server.log'] Command:[docker exec roottestreloadclientcertificate-gw8-node1-1 bash -c echo -n > /var/log/clickhouse-server/clickhouse-server.log] Command:[docker exec roottestreloadclientcertificate-gw8-node1-1 bash -c echo -n > /var/log/clickhouse-server/clickhouse-server.log] run container_id:roottestreloadclientcertificate-gw8-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo -n > /var/log/clickhouse-server/clickhouse-server.log'] run container_id:roottestreloadclientcertificate-gw8-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo -n > /var/log/clickhouse-server/clickhouse-server.log'] Command:[docker exec roottestreloadclientcertificate-gw8-node2-1 bash -c echo -n > /var/log/clickhouse-server/clickhouse-server.log] Command:[docker exec roottestreloadclientcertificate-gw8-node2-1 bash -c echo -n > /var/log/clickhouse-server/clickhouse-server.log] get_instance_ip instance_name=zoo1 get_instance_ip instance_name=zoo1 http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw8-zoo1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw8-zoo1-1/json HTTP/1.1" 200 None get_kazoo_client: zoo1, ip:172.16.4.2, port:2281, use_ssl:True get_kazoo_client: zoo1, ip:172.16.4.2, port:2281, use_ssl:True Connecting to 172.16.4.2(172.16.4.2):2281, use_ssl: True Connecting to 172.16.4.2(172.16.4.2):2281, use_ssl: True Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query drop table if exists data; create table data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3'; on node Executing query drop table if exists data; create table data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3'; on node Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,num2) SELECT number + 0 AS num, number + 1 + 0 AS num2 FROM numbers_mt(1000) on node1 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,num2) SELECT number + 0 AS num, number + 1 + 0 AS num2 FROM numbers_mt(1000) on node1 [gw4] PASSED test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/max_background_jobs/no_such_option/g' /etc/clickhouse-server/config.d/rocksdb.xml"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/max_background_jobs/no_such_option/g' /etc/clickhouse-server/config.d/rocksdb.xml"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c sed -i 's/max_background_jobs/no_such_option/g' /etc/clickhouse-server/config.d/rocksdb.xml] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c sed -i 's/max_background_jobs/no_such_option/g' /etc/clickhouse-server/config.d/rocksdb.xml] Connecting to 172.16.4.2(172.16.4.2):2281, use_ssl: True Connecting to 172.16.4.2(172.16.4.2):2281, use_ssl: True Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c ps -C clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c ps -C clickhouse] Stdout: PID TTY TIME CMD Stdout: PID TTY TIME CMD Stdout: 3105 ? 00:00:02 clickhouse Stdout: 3105 ? 00:00:02 clickhouse run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c pkill clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c pkill clickhouse] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', "echo 'prod_merges' > /etc/clickhouse-server/config.d/workloads.xml"] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', "echo 'prod_merges' > /etc/clickhouse-server/config.d/workloads.xml"] Command:[docker exec roottestscheduler-gw3-node-1 bash -c echo 'prod_merges' > /etc/clickhouse-server/config.d/workloads.xml] Command:[docker exec roottestscheduler-gw3-node-1 bash -c echo 'prod_merges' > /etc/clickhouse-server/config.d/workloads.xml] Executing query system reload config on node Executing query system reload config on node Stdout:3105 Stdout:3105 Connecting to 172.16.4.2(172.16.4.2):2281, use_ssl: True Connecting to 172.16.4.2(172.16.4.2):2281, use_ssl: True Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/prod_merges' on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/prod_merges' on node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/prod_merges' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/prod_merges' on node Executing query insert into data select * from numbers(1e4) on node Executing query insert into data select * from numbers(1e4) on node run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:3105 Stdout:3105 Executing query insert into data select * from numbers(2e4) on node Executing query insert into data select * from numbers(2e4) on node Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance [gw6] PASSED test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list Executing query INSERT INTO FUNCTION s3('http://minio1:9001/root/data/proxy_list_node/test.csv', 'minio', 'minio123', 'CSV', 'key String, value String') VALUES ('color','red'),('size','10') on proxy_list_node Executing query INSERT INTO FUNCTION s3('http://minio1:9001/root/data/proxy_list_node/test.csv', 'minio', 'minio123', 'CSV', 'key String, value String') VALUES ('color','red'),('size','10') on proxy_list_node Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Connection dropped: socket connection broken Connection dropped: socket connection broken Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query insert into data select * from numbers(3e4) on node Executing query insert into data select * from numbers(3e4) on node Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query SELECT * FROM s3('http://minio1:9001/root/data/proxy_list_node/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on proxy_list_node Executing query SELECT * FROM s3('http://minio1:9001/root/data/proxy_list_node/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on proxy_list_node Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Connecting to 172.16.4.2(172.16.4.2):2281, use_ssl: True Connecting to 172.16.4.2(172.16.4.2):2281, use_ssl: True Executing query optimize table data final on node Executing query optimize table data final on node Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['zookeeper', 'clickhouse'] Received response(xid=1): ['zookeeper', 'clickhouse'] Sending request(xid=2): Close() Sending request(xid=2): Close() Executing query SELECT * FROM s3('http://minio1:9001/root/data/proxy_list_node/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on proxy_list_node Executing query SELECT * FROM s3('http://minio1:9001/root/data/proxy_list_node/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on proxy_list_node Closing connection to 172.16.4.2:2281 Closing connection to 172.16.4.2:2281 Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo2 get_instance_ip instance_name=zoo2 http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw8-zoo2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw8-zoo2-1/json HTTP/1.1" 200 None get_kazoo_client: zoo2, ip:172.16.4.3, port:2281, use_ssl:True get_kazoo_client: zoo2, ip:172.16.4.3, port:2281, use_ssl:True Connecting to 172.16.4.3(172.16.4.3):2281, use_ssl: True Connecting to 172.16.4.3(172.16.4.3):2281, use_ssl: True Executing query SHOW DATABASES on instance Executing query SHOW DATABASES on instance run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/prod_merges' on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/prod_merges' on node Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Stopped Stopping zookeeper node: zoo3 Stopping zookeeper node: zoo3 Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop zoo3] Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop zoo3] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['zookeeper', 'clickhouse'] Received response(xid=1): ['zookeeper', 'clickhouse'] Sending request(xid=2): Close() Sending request(xid=2): Close() Closing connection to 172.16.4.3:2281 Closing connection to 172.16.4.3:2281 Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo3 get_instance_ip instance_name=zoo3 http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw8-zoo3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw8-zoo3-1/json HTTP/1.1" 200 None get_kazoo_client: zoo3, ip:172.16.4.4, port:2281, use_ssl:True get_kazoo_client: zoo3, ip:172.16.4.4, port:2281, use_ssl:True Connecting to 172.16.4.4(172.16.4.4):2281, use_ssl: True Connecting to 172.16.4.4(172.16.4.4):2281, use_ssl: True No clickhouse process running. Start new one. No clickhouse process running. Start new one. http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw4-node-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw4-node-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/0d9b8ffeed8d25680b1341fd9d096c650b32eb47c44fbb292c4eb175934211d3/start HTTP/1.1" 200 0 http://localhost:None "POST /v1.46/exec/0d9b8ffeed8d25680b1341fd9d096c650b32eb47c44fbb292c4eb175934211d3/start HTTP/1.1" 200 0 http://localhost:None "GET /v1.46/exec/0d9b8ffeed8d25680b1341fd9d096c650b32eb47c44fbb292c4eb175934211d3/json HTTP/1.1" 200 586 http://localhost:None "GET /v1.46/exec/0d9b8ffeed8d25680b1341fd9d096c650b32eb47c44fbb292c4eb175934211d3/json HTTP/1.1" 200 586 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/prod_merges' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/prod_merges' on node Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['zookeeper', 'clickhouse'] Received response(xid=1): ['zookeeper', 'clickhouse'] Sending request(xid=2): Close() Sending request(xid=2): Close() Closing connection to 172.16.4.4:2281 Closing connection to 172.16.4.4:2281 Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED All instances of ZooKeeper started: ['zoo1', 'zoo2', 'zoo3'] All instances of ZooKeeper started: ['zoo1', 'zoo2', 'zoo3'] Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', "echo 'dev_merges' > /etc/clickhouse-server/config.d/workloads.xml"] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', "echo 'dev_merges' > /etc/clickhouse-server/config.d/workloads.xml"] Command:[docker exec roottestscheduler-gw3-node-1 bash -c echo 'dev_merges' > /etc/clickhouse-server/config.d/workloads.xml] Command:[docker exec roottestscheduler-gw3-node-1 bash -c echo 'dev_merges' > /etc/clickhouse-server/config.d/workloads.xml] Executing query system reload config on node Executing query system reload config on node Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node2 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node2 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster RENAME COLUMN num2 to foo2 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster RENAME COLUMN num2 to foo2 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster RENAME COLUMN num2 to foo2 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster RENAME COLUMN num2 to foo2 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster RENAME COLUMN foo2 to foo3 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster RENAME COLUMN foo2 to foo3 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster RENAME COLUMN foo2 to foo3 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster RENAME COLUMN foo2 to foo3 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster RENAME COLUMN foo3 to num2 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster RENAME COLUMN foo3 to num2 on node1 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,foo3) SELECT number + 0 AS num, number + 1 + 0 AS foo3 FROM numbers_mt(10) on node1 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,foo3) SELECT number + 0 AS num, number + 1 + 0 AS foo3 FROM numbers_mt(10) on node1 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,num2) SELECT number + 0 AS num, number + 1 + 0 AS num2 FROM numbers_mt(10) on node2 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,num2) SELECT number + 0 AS num, number + 1 + 0 AS num2 FROM numbers_mt(10) on node2 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,foo2) SELECT number + 0 AS num, number + 1 + 0 AS foo2 FROM numbers_mt(10) on node3 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,foo2) SELECT number + 0 AS num, number + 1 + 0 AS foo2 FROM numbers_mt(10) on node3 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE foo2 % 1000 > 0 on node1 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE foo3 % 1000 > 0 on node2 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster RENAME COLUMN foo3 to num2 on node1 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE num2 % 1000 > 0 on node3 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE foo2 % 1000 > 0 on node1 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE foo3 % 1000 > 0 on node2 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster RENAME COLUMN foo3 to num2 on node1 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE num2 % 1000 > 0 on node3 run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/dev_merges' on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/dev_merges' on node Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Stdout:3872 Stdout:3872 Clickhouse process running. Clickhouse process running. run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:3872 Stdout:3872 Executing query select 20 on node Executing query select 20 on node Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE foo3 % 1000 > 0 on node2 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE foo3 % 1000 > 0 on node2 Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/dev_merges' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/dev_merges' on node Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,foo3) SELECT number + 0 AS num, number + 1 + 0 AS foo3 FROM numbers_mt(10) on node1 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,foo3) SELECT number + 0 AS num, number + 1 + 0 AS foo3 FROM numbers_mt(10) on node1 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE foo2 % 1000 > 0 on node1 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE foo2 % 1000 > 0 on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster RENAME COLUMN num2 to foo2 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster RENAME COLUMN num2 to foo2 on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,foo2) SELECT number + 0 AS num, number + 1 + 0 AS foo2 FROM numbers_mt(10) on node3 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,foo2) SELECT number + 0 AS num, number + 1 + 0 AS foo2 FROM numbers_mt(10) on node3 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,num2) SELECT number + 0 AS num, number + 1 + 0 AS num2 FROM numbers_mt(10) on node2 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,num2) SELECT number + 0 AS num, number + 1 + 0 AS num2 FROM numbers_mt(10) on node2 Executing query insert into data select * from numbers(1e4) on node Executing query insert into data select * from numbers(1e4) on node Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE foo3 % 1000 > 0 on node2 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE foo3 % 1000 > 0 on node2 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Stderr: Container roottests3lowcardinalityrightborder-gw9-resolver-1 Stopping Stderr: Container roottests3lowcardinalityrightborder-gw9-resolver-1 Stopping Stderr: Container roottests3lowcardinalityrightborder-gw9-node1-1 Stopping Stderr: Container roottests3lowcardinalityrightborder-gw9-node1-1 Stopping Stderr: Container roottests3lowcardinalityrightborder-gw9-node1-1 Stopped Stderr: Container roottests3lowcardinalityrightborder-gw9-node1-1 Stopped Stderr: Container roottests3lowcardinalityrightborder-gw9-minio1-1 Stopping Stderr: Container roottests3lowcardinalityrightborder-gw9-minio1-1 Stopping Stderr: Container roottests3lowcardinalityrightborder-gw9-minio1-1 Stopped Stderr: Container roottests3lowcardinalityrightborder-gw9-minio1-1 Stopped Stderr: Container roottests3lowcardinalityrightborder-gw9-resolver-1 Stopped Stderr: Container roottests3lowcardinalityrightborder-gw9-resolver-1 Stopped Stderr: Container roottests3lowcardinalityrightborder-gw9-proxy2-1 Stopping Stderr: Container roottests3lowcardinalityrightborder-gw9-proxy2-1 Stopping Stderr: Container roottests3lowcardinalityrightborder-gw9-proxy1-1 Stopping Stderr: Container roottests3lowcardinalityrightborder-gw9-proxy1-1 Stopping Stderr: Container roottests3lowcardinalityrightborder-gw9-proxy2-1 Stopped Stderr: Container roottests3lowcardinalityrightborder-gw9-proxy2-1 Stopped Stderr: Container roottests3lowcardinalityrightborder-gw9-proxy1-1 Stopped Stderr: Container roottests3lowcardinalityrightborder-gw9-proxy1-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw9/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw9/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw9/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw9/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw9/.env --project-name roottests3lowcardinalityrightborder-gw9 --file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw9/.env --project-name roottests3lowcardinalityrightborder-gw9 --file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml down --volumes] Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,foo3) SELECT number + 0 AS num, number + 1 + 0 AS foo3 FROM numbers_mt(10) on node1 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,foo3) SELECT number + 0 AS num, number + 1 + 0 AS foo3 FROM numbers_mt(10) on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE num2 % 1000 > 0 on node3 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE num2 % 1000 > 0 on node3 Executing query select 20 on node Executing query select 20 on node Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE foo3 % 1000 > 0 on node2 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE foo3 % 1000 > 0 on node2 Executing query insert into data select * from numbers(2e4) on node Executing query insert into data select * from numbers(2e4) on node Executing query DROP DATABASE IF EXISTS "postgres_database" on instance [gw1] PASSED test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,num2) SELECT number + 0 AS num, number + 1 + 0 AS num2 FROM numbers_mt(10) on node2 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,num2) SELECT number + 0 AS num, number + 1 + 0 AS num2 FROM numbers_mt(10) on node2 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE foo2 % 1000 > 0 on node1 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE foo2 % 1000 > 0 on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE num2 % 1000 > 0 on node3 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE num2 % 1000 > 0 on node3 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,foo3) SELECT number + 0 AS num, number + 1 + 0 AS foo3 FROM numbers_mt(10) on node1 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,foo3) SELECT number + 0 AS num, number + 1 + 0 AS foo3 FROM numbers_mt(10) on node1 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE foo3 % 1000 > 0 on node2 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE foo3 % 1000 > 0 on node2 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,num2) SELECT number + 0 AS num, number + 1 + 0 AS num2 FROM numbers_mt(10) on node2 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,num2) SELECT number + 0 AS num, number + 1 + 0 AS num2 FROM numbers_mt(10) on node2 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Executing query insert into data select * from numbers(3e4) on node Executing query insert into data select * from numbers(3e4) on node Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,foo2) SELECT number + 0 AS num, number + 1 + 0 AS foo2 FROM numbers_mt(10) on node3 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,foo2) SELECT number + 0 AS num, number + 1 + 0 AS foo2 FROM numbers_mt(10) on node3 Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE num2 % 1000 > 0 on node3 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE num2 % 1000 > 0 on node3 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,foo3) SELECT number + 0 AS num, number + 1 + 0 AS foo3 FROM numbers_mt(10) on node1 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,foo3) SELECT number + 0 AS num, number + 1 + 0 AS foo3 FROM numbers_mt(10) on node1 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,num2) SELECT number + 0 AS num, number + 1 + 0 AS num2 FROM numbers_mt(10) on node2 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,num2) SELECT number + 0 AS num, number + 1 + 0 AS num2 FROM numbers_mt(10) on node2 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE num2 % 1000 > 0 on node3 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE num2 % 1000 > 0 on node3 Stderr: Container roottests3lowcardinalityrightborder-gw9-node1-1 Stopping Stderr: Container roottests3lowcardinalityrightborder-gw9-node1-1 Stopping Stderr: Container roottests3lowcardinalityrightborder-gw9-resolver-1 Stopping Stderr: Container roottests3lowcardinalityrightborder-gw9-resolver-1 Stopping Stderr: Container roottests3lowcardinalityrightborder-gw9-node1-1 Stopped Stderr: Container roottests3lowcardinalityrightborder-gw9-node1-1 Stopped Stderr: Container roottests3lowcardinalityrightborder-gw9-node1-1 Removing Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Stderr: Container roottests3lowcardinalityrightborder-gw9-node1-1 Removing Stderr: Container roottests3lowcardinalityrightborder-gw9-resolver-1 Stopped Stderr: Container roottests3lowcardinalityrightborder-gw9-resolver-1 Stopped Stderr: Container roottests3lowcardinalityrightborder-gw9-resolver-1 Removing Stderr: Container roottests3lowcardinalityrightborder-gw9-resolver-1 Removing Stderr: Container roottests3lowcardinalityrightborder-gw9-resolver-1 Removed Stderr: Container roottests3lowcardinalityrightborder-gw9-resolver-1 Removed Stderr: Container roottests3lowcardinalityrightborder-gw9-node1-1 Removed Stderr: Container roottests3lowcardinalityrightborder-gw9-node1-1 Removed Stderr: Container roottests3lowcardinalityrightborder-gw9-minio1-1 Stopping Stderr: Container roottests3lowcardinalityrightborder-gw9-minio1-1 Stopping Stderr: Container roottests3lowcardinalityrightborder-gw9-minio1-1 Stopped Stderr: Container roottests3lowcardinalityrightborder-gw9-minio1-1 Stopped Stderr: Container roottests3lowcardinalityrightborder-gw9-minio1-1 Removing Stderr: Container roottests3lowcardinalityrightborder-gw9-minio1-1 Removing Stderr: Container roottests3lowcardinalityrightborder-gw9-minio1-1 Removed Stderr: Container roottests3lowcardinalityrightborder-gw9-minio1-1 Removed Stderr: Container roottests3lowcardinalityrightborder-gw9-proxy2-1 Stopping Stderr: Container roottests3lowcardinalityrightborder-gw9-proxy2-1 Stopping Stderr: Container roottests3lowcardinalityrightborder-gw9-proxy1-1 Stopping Stderr: Container roottests3lowcardinalityrightborder-gw9-proxy1-1 Stopping Stderr: Container roottests3lowcardinalityrightborder-gw9-proxy1-1 Stopped Stderr: Container roottests3lowcardinalityrightborder-gw9-proxy1-1 Stopped Stderr: Container roottests3lowcardinalityrightborder-gw9-proxy1-1 Removing Stderr: Container roottests3lowcardinalityrightborder-gw9-proxy1-1 Removing Stderr: Container roottests3lowcardinalityrightborder-gw9-proxy2-1 Stopped Stderr: Container roottests3lowcardinalityrightborder-gw9-proxy2-1 Stopped Stderr: Container roottests3lowcardinalityrightborder-gw9-proxy2-1 Removing Stderr: Container roottests3lowcardinalityrightborder-gw9-proxy2-1 Removing Stderr: Container roottests3lowcardinalityrightborder-gw9-proxy2-1 Removed Stderr: Container roottests3lowcardinalityrightborder-gw9-proxy2-1 Removed Stderr: Container roottests3lowcardinalityrightborder-gw9-proxy1-1 Removed Stderr: Container roottests3lowcardinalityrightborder-gw9-proxy1-1 Removed Executing query select 20 on node Executing query select 20 on node Stderr: Volume roottests3lowcardinalityrightborder-gw9_data1-1 Removing Stderr: Volume roottests3lowcardinalityrightborder-gw9_data1-1 Removing Stderr: Volume roottests3lowcardinalityrightborder-gw9_data1-1 Removed Stderr: Volume roottests3lowcardinalityrightborder-gw9_data1-1 Removed Stderr: Network roottests3lowcardinalityrightborder-gw9_default Removing Stderr: Network roottests3lowcardinalityrightborder-gw9_default Removing Stderr: Network roottests3lowcardinalityrightborder-gw9_default Removed Stderr: Network roottests3lowcardinalityrightborder-gw9_default Removed Cleanup called Cleanup called Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query optimize table data final on node Executing query optimize table data final on node Docker networks for project roottests3lowcardinalityrightborder-gw9 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3lowcardinalityrightborder-gw9 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3lowcardinalityrightborder-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3lowcardinalityrightborder-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3lowcardinalityrightborder-gw9 are DRIVER VOLUME NAME Docker volumes for project roottests3lowcardinalityrightborder-gw9 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottests3lowcardinalityrightborder-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottests3lowcardinalityrightborder-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottests3lowcardinalityrightborder-gw9 No running containers for project: roottests3lowcardinalityrightborder-gw9 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] run container_id:roottestreloadclientcertificate-gw8-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'grep -a "Code: 210." /var/log/clickhouse-server/clickhouse-server.log | wc -l'] run container_id:roottestreloadclientcertificate-gw8-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'grep -a "Code: 210." /var/log/clickhouse-server/clickhouse-server.log | wc -l'] Command:[docker exec roottestreloadclientcertificate-gw8-node1-1 bash -c grep -a "Code: 210." /var/log/clickhouse-server/clickhouse-server.log | wc -l] Command:[docker exec roottestreloadclientcertificate-gw8-node1-1 bash -c grep -a "Code: 210." /var/log/clickhouse-server/clickhouse-server.log | wc -l] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:11 Stdout:11 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 11 Volumes pruned: 11 Stdout:0 Stdout:0 test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log Setup Keeper Setup Keeper Cluster name: project_name:roottestreplicateds3zerocopydroppartition-gw9. Added instance name:node1 tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/.env', '--project-name', 'roottestreplicateds3zerocopydroppartition-gw9', '--file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Cluster name: project_name:roottestreplicateds3zerocopydroppartition-gw9. Added instance name:node1 tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/.env', '--project-name', 'roottestreplicateds3zerocopydroppartition-gw9', '--file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Executing query INSERT INTO `postgres_database`.postgresql_replica_0 SELECT number, number from numbers(50) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_0 SELECT number, number from numbers(50) on instance Running tests in /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/test.py Running tests in /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/test.py Cluster start called. is_up=False Cluster start called. is_up=False [gw8] PASSED test_reload_client_certificate/test.py::test_correct_cn_cert Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE foo2 % 1000 > 0 on node1 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE foo2 % 1000 > 0 on node1 Docker networks for project roottestreplicateds3zerocopydroppartition-gw9 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicateds3zerocopydroppartition-gw9 are NETWORK ID NAME DRIVER SCOPE Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,foo2) SELECT number + 0 AS num, number + 1 + 0 AS foo2 FROM numbers_mt(10) on node3 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,foo2) SELECT number + 0 AS num, number + 1 + 0 AS foo2 FROM numbers_mt(10) on node3 run container_id:roottestreloadclientcertificate-gw8-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF\n\n \n \n /etc/clickhouse-server/config.d/first_client.crt\n /etc/clickhouse-server/config.d/first_client.key\n true\n true\n sslv2,sslv3\n true\n none\n \n RejectCertificateHandler\n \n \n \n\nEOF'] run container_id:roottestreloadclientcertificate-gw8-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF\n\n \n \n /etc/clickhouse-server/config.d/first_client.crt\n /etc/clickhouse-server/config.d/first_client.key\n true\n true\n sslv2,sslv3\n true\n none\n \n RejectCertificateHandler\n \n \n \n\nEOF'] Command:[docker exec roottestreloadclientcertificate-gw8-node1-1 bash -c cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF /etc/clickhouse-server/config.d/first_client.crt /etc/clickhouse-server/config.d/first_client.key true true sslv2,sslv3 true none RejectCertificateHandler EOF] Command:[docker exec roottestreloadclientcertificate-gw8-node1-1 bash -c cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF /etc/clickhouse-server/config.d/first_client.crt /etc/clickhouse-server/config.d/first_client.key true true sslv2,sslv3 true none RejectCertificateHandler EOF] test_reload_client_certificate/test.py::test_wrong_cn_cert Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/dev_merges' on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/dev_merges' on node Docker containers for project roottestreplicateds3zerocopydroppartition-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicateds3zerocopydroppartition-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreplicateds3zerocopydroppartition-gw9 are DRIVER VOLUME NAME Docker volumes for project roottestreplicateds3zerocopydroppartition-gw9 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker networks for project roottestreplicateds3zerocopydroppartition-gw9 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicateds3zerocopydroppartition-gw9 are NETWORK ID NAME DRIVER SCOPE run container_id:roottestreloadclientcertificate-gw8-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'touch /etc/clickhouse-server/config.d/ssl_conf.xml'] run container_id:roottestreloadclientcertificate-gw8-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'touch /etc/clickhouse-server/config.d/ssl_conf.xml'] Command:[docker exec roottestreloadclientcertificate-gw8-node1-1 bash -c touch /etc/clickhouse-server/config.d/ssl_conf.xml] Command:[docker exec roottestreloadclientcertificate-gw8-node1-1 bash -c touch /etc/clickhouse-server/config.d/ssl_conf.xml] Docker containers for project roottestreplicateds3zerocopydroppartition-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicateds3zerocopydroppartition-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreplicateds3zerocopydroppartition-gw9 are DRIVER VOLUME NAME Docker volumes for project roottestreplicateds3zerocopydroppartition-gw9 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestreplicateds3zerocopydroppartition-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestreplicateds3zerocopydroppartition-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] run container_id:roottestreloadclientcertificate-gw8-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF\n\n \n \n /etc/clickhouse-server/config.d/first_client.crt\n /etc/clickhouse-server/config.d/first_client.key\n true\n true\n sslv2,sslv3\n true\n none\n \n RejectCertificateHandler\n \n \n \n\nEOF'] run container_id:roottestreloadclientcertificate-gw8-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF\n\n \n \n /etc/clickhouse-server/config.d/first_client.crt\n /etc/clickhouse-server/config.d/first_client.key\n true\n true\n sslv2,sslv3\n true\n none\n \n RejectCertificateHandler\n \n \n \n\nEOF'] Command:[docker exec roottestreloadclientcertificate-gw8-node2-1 bash -c cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF /etc/clickhouse-server/config.d/first_client.crt /etc/clickhouse-server/config.d/first_client.key true true sslv2,sslv3 true none RejectCertificateHandler EOF] Command:[docker exec roottestreloadclientcertificate-gw8-node2-1 bash -c cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF /etc/clickhouse-server/config.d/first_client.crt /etc/clickhouse-server/config.d/first_client.key true true sslv2,sslv3 true none RejectCertificateHandler EOF] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestreplicateds3zerocopydroppartition-gw9 No running containers for project: roottestreplicateds3zerocopydroppartition-gw9 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] run container_id:roottestreloadclientcertificate-gw8-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'touch /etc/clickhouse-server/config.d/ssl_conf.xml'] run container_id:roottestreloadclientcertificate-gw8-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'touch /etc/clickhouse-server/config.d/ssl_conf.xml'] Command:[docker exec roottestreloadclientcertificate-gw8-node2-1 bash -c touch /etc/clickhouse-server/config.d/ssl_conf.xml] Command:[docker exec roottestreloadclientcertificate-gw8-node2-1 bash -c touch /etc/clickhouse-server/config.d/ssl_conf.xml] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query INSERT INTO `postgres_database`.postgresql_replica_1 SELECT number, number from numbers(50) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_1 SELECT number, number from numbers(50) on instance Stdout:11 Stdout:11 Command:[docker volume prune -f] Command:[docker volume prune -f] Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,foo2) SELECT number + 0 AS num, number + 1 + 0 AS foo2 FROM numbers_mt(10) on node3 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,foo2) SELECT number + 0 AS num, number + 1 + 0 AS foo2 FROM numbers_mt(10) on node3 Stopping zookeeper node: zoo1 Stopping zookeeper node: zoo1 Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo1] Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo1] http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 11 Volumes pruned: 11 Setup directory for instance: node1 Setup directory for instance: node1 Create directory for configuration generated in this helper http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/configs/storage_conf.xml'] to /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/node1/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/configs/storage_conf.xml'] to /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/node1/configs/config.d Setup database dir /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/node1/database Setup database dir /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/node1/database Setup logs dir /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/node1/logs Setup logs dir /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/node1/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/keeper3/coordination', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/keeper3/coordination', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/.env --project-name roottestreplicateds3zerocopydroppartition-gw9 --file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/.env --project-name roottestreplicateds3zerocopydroppartition-gw9 --file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml pull] Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/dev_merges' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/dev_merges' on node Executing query select 20 on node Executing query select 20 on node Executing query INSERT INTO `postgres_database`.postgresql_replica_2 SELECT number, number from numbers(50) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_2 SELECT number, number from numbers(50) on instance Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE foo2 % 1000 > 0 on node1 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE foo2 % 1000 > 0 on node1 [gw3] PASSED test_scheduler/test.py::test_merge_workload_change test_scheduler/test.py::test_merge_workload_override Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB PRIMARY KEY(key); on node Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB PRIMARY KEY(key); on node Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query INSERT INTO `postgres_database`.postgresql_replica_3 SELECT number, number from numbers(50) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_3 SELECT number, number from numbers(50) on instance run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None Executing query system reload config on node Executing query system reload config on node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Executing query INSERT INTO `postgres_database`.postgresql_replica_4 SELECT number, number from numbers(50) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_4 SELECT number, number from numbers(50) on instance run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/no_such_option/max_background_jobs/g' /etc/clickhouse-server/config.d/rocksdb.xml"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/no_such_option/max_background_jobs/g' /etc/clickhouse-server/config.d/rocksdb.xml"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c sed -i 's/no_such_option/max_background_jobs/g' /etc/clickhouse-server/config.d/rocksdb.xml] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c sed -i 's/no_such_option/max_background_jobs/g' /etc/clickhouse-server/config.d/rocksdb.xml] Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Stopping Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Stopping Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Stopped Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Stopped Stopping zookeeper node: zoo2 Stopping zookeeper node: zoo2 Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo2] Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo2] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c ps -C clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c ps -C clickhouse] Stdout: PID TTY TIME CMD Stdout: PID TTY TIME CMD Stdout: 3872 ? 00:00:02 clickhouse Stdout: 3872 ? 00:00:02 clickhouse run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c pkill clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c pkill clickhouse] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:3872 Stdout:3872 Executing query drop table if exists prod_data; drop table if exists dev_data; create table prod_data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3', merge_workload='prod_merges'; create table dev_data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3', merge_workload='dev_merges'; on node Executing query drop table if exists prod_data; drop table if exists dev_data; create table prod_data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3', merge_workload='prod_merges'; create table dev_data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3', merge_workload='dev_merges'; on node Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/prod_merges' on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/prod_merges' on node Executing query SHOW DATABASES on instance Executing query SHOW DATABASES on instance Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Stopping Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Stopping Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Stopped Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Stopped Stopping zookeeper node: zoo3 Stopping zookeeper node: zoo3 Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo3] Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo3] Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/prod_merges' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/prod_merges' on node Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/dev_merges' on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/dev_merges' on node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/dev_merges' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/dev_merges' on node run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:3872 Stdout:3872 Executing query select * from `postgres_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_0` order by key; on instance Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Stopping Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Stopping Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Stopped Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Stopped Starting zookeeper node: zoo1 Starting zookeeper node: zoo1 Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo1] Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo1] Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster RENAME COLUMN num2 to foo2 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster RENAME COLUMN num2 to foo2 on node1 Executing query insert into prod_data select * from numbers(1e4) on node Executing query insert into prod_data select * from numbers(1e4) on node Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster RENAME COLUMN foo3 to num2 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster RENAME COLUMN foo3 to num2 on node1 Executing query insert into prod_data select * from numbers(2e4) on node Executing query insert into prod_data select * from numbers(2e4) on node Executing query SELECT * FROM `test_database`.`postgresql_replica_1` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_1` LIMIT 1 FORMAT Null on instance Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster RENAME COLUMN foo3 to num2 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster RENAME COLUMN foo3 to num2 on node1 Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Starting Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Starting Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Started Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Started Starting zookeeper node: zoo2 Starting zookeeper node: zoo2 Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo2] Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo2] http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Executing query insert into prod_data select * from numbers(3e4) on node Executing query insert into prod_data select * from numbers(3e4) on node Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_1' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_1' on instance run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:3872 Stdout:3872 Executing query select * from `postgres_database`.`postgresql_replica_1` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_1` order by key; on instance Executing query insert into dev_data select * from numbers(1e4) on node Executing query insert into dev_data select * from numbers(1e4) on node Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Starting Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Starting Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Started Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Started Starting zookeeper node: zoo3 Starting zookeeper node: zoo3 Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo3] Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo3] Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query select * from `test_database`.`postgresql_replica_1` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_1` order by key; on instance Executing query insert into dev_data select * from numbers(2e4) on node Executing query insert into dev_data select * from numbers(2e4) on node Executing query SELECT * FROM `test_database`.`postgresql_replica_2` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_2` LIMIT 1 FORMAT Null on instance http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Starting Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Starting Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Started Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Started get_instance_ip instance_name=zoo1 get_instance_ip instance_name=zoo1 http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw8-zoo1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw8-zoo1-1/json HTTP/1.1" 200 None get_kazoo_client: zoo1, ip:172.16.4.2, port:2281, use_ssl:True get_kazoo_client: zoo1, ip:172.16.4.2, port:2281, use_ssl:True Connecting to 172.16.4.2(172.16.4.2):2281, use_ssl: True Connecting to 172.16.4.2(172.16.4.2):2281, use_ssl: True Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_2' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_2' on instance Executing query insert into dev_data select * from numbers(3e4) on node Executing query insert into dev_data select * from numbers(3e4) on node Connecting to 172.16.4.2(172.16.4.2):2281, use_ssl: True Connecting to 172.16.4.2(172.16.4.2):2281, use_ssl: True Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query select * from `postgres_database`.`postgresql_replica_2` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_2` order by key; on instance run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query optimize table prod_data final on node Executing query optimize table prod_data final on node Connecting to 172.16.4.2(172.16.4.2):2281, use_ssl: True Connecting to 172.16.4.2(172.16.4.2):2281, use_ssl: True Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused No clickhouse process running. Start new one. No clickhouse process running. Start new one. http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw4-node-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw4-node-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/eb7c9bbfbcd9b76c815926b943e87d14c40d5bca9da63b2acaa6708bcff55189/start HTTP/1.1" 200 0 http://localhost:None "POST /v1.46/exec/eb7c9bbfbcd9b76c815926b943e87d14c40d5bca9da63b2acaa6708bcff55189/start HTTP/1.1" 200 0 http://localhost:None "GET /v1.46/exec/eb7c9bbfbcd9b76c815926b943e87d14c40d5bca9da63b2acaa6708bcff55189/json HTTP/1.1" 200 586 http://localhost:None "GET /v1.46/exec/eb7c9bbfbcd9b76c815926b943e87d14c40d5bca9da63b2acaa6708bcff55189/json HTTP/1.1" 200 586 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query select * from `test_database`.`postgresql_replica_2` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_2` order by key; on instance Executing query optimize table dev_data final on node Executing query optimize table dev_data final on node Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Stopped Executing query SELECT name FROM system.functions WHERE name IN ['f1', 'f2'] ORDER BY name on node2 Executing query SELECT name FROM system.functions WHERE name IN ['f1', 'f2'] ORDER BY name on node2 Executing query SELECT * FROM `test_database`.`postgresql_replica_3` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_3` LIMIT 1 FORMAT Null on instance Connecting to 172.16.4.2(172.16.4.2):2281, use_ssl: True Connecting to 172.16.4.2(172.16.4.2):2281, use_ssl: True Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/prod_merges' on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/prod_merges' on node Executing query CREATE FUNCTION f3 AS (x, y) -> x * y on node1 Executing query CREATE FUNCTION f3 AS (x, y) -> x * y on node1 Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_3' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_3' on instance http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/prod_merges' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/prod_merges' on node Executing query select * from `postgres_database`.`postgresql_replica_3` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_3` order by key; on instance Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/dev_merges' on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/dev_merges' on node run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query select * from `test_database`.`postgresql_replica_3` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_3` order by key; on instance Stdout:4651 Stdout:4651 Clickhouse process running. Clickhouse process running. run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/dev_merges' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/dev_merges' on node Stdout:4651 Stdout:4651 Executing query select 20 on node Executing query select 20 on node Executing query SELECT * FROM `test_database`.`postgresql_replica_4` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_4` LIMIT 1 FORMAT Null on instance Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Connection dropped: socket connection broken Connection dropped: socket connection broken [gw3] PASSED test_scheduler/test.py::test_merge_workload_override test_scheduler/test.py::test_mutate_workload Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_4' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_4' on instance run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] [gw6] PASSED test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list Executing query INSERT INTO FUNCTION s3('http://minio1:9001/root/data/proxy_list_node_no_proxy/test.csv', 'minio', 'minio123', 'CSV', 'key String, value String') VALUES ('color','red'),('size','10') on proxy_list_node_no_proxy Executing query INSERT INTO FUNCTION s3('http://minio1:9001/root/data/proxy_list_node_no_proxy/test.csv', 'minio', 'minio123', 'CSV', 'key String, value String') VALUES ('color','red'),('size','10') on proxy_list_node_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list_no_proxy run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Executing query system reload config on node Executing query system reload config on node Executing query select * from `postgres_database`.`postgresql_replica_4` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_4` order by key; on instance Connecting to 172.16.4.2(172.16.4.2):2281, use_ssl: True Connecting to 172.16.4.2(172.16.4.2):2281, use_ssl: True Executing query select 20 on node Executing query select 20 on node Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['zookeeper', 'clickhouse'] Received response(xid=1): ['zookeeper', 'clickhouse'] Sending request(xid=2): Close() Sending request(xid=2): Close() Executing query SELECT * FROM s3('http://minio1:9001/root/data/proxy_list_node_no_proxy/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on proxy_list_node_no_proxy Executing query SELECT * FROM s3('http://minio1:9001/root/data/proxy_list_node_no_proxy/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on proxy_list_node_no_proxy Closing connection to 172.16.4.2:2281 Closing connection to 172.16.4.2:2281 Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo2 get_instance_ip instance_name=zoo2 http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw8-zoo2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw8-zoo2-1/json HTTP/1.1" 200 None get_kazoo_client: zoo2, ip:172.16.4.3, port:2281, use_ssl:True get_kazoo_client: zoo2, ip:172.16.4.3, port:2281, use_ssl:True Connecting to 172.16.4.3(172.16.4.3):2281, use_ssl: True Connecting to 172.16.4.3(172.16.4.3):2281, use_ssl: True Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster RENAME COLUMN foo2 to foo3 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster RENAME COLUMN foo2 to foo3 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster RENAME COLUMN foo3 to num2 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster RENAME COLUMN foo3 to num2 on node1 Executing query select * from `test_database`.`postgresql_replica_4` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_4` order by key; on instance Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster RENAME COLUMN foo2 to foo3 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster RENAME COLUMN foo2 to foo3 on node1 Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster RENAME COLUMN num2 to foo2 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster RENAME COLUMN num2 to foo2 on node1 Executing query drop table if exists data; create table data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3'; on node Executing query drop table if exists data; create table data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3'; on node Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster RENAME COLUMN num2 to foo2 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster RENAME COLUMN num2 to foo2 on node1 Executing query SELECT count() FROM system.tables WHERE database = 'test_database'; on instance Executing query SELECT count() FROM system.tables WHERE database = 'test_database'; on instance Executing query SELECT * FROM s3('http://minio1:9001/root/data/proxy_list_node_no_proxy/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on proxy_list_node_no_proxy Executing query SELECT * FROM s3('http://minio1:9001/root/data/proxy_list_node_no_proxy/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on proxy_list_node_no_proxy Executing query insert into data select * from numbers(1e4) on node Executing query insert into data select * from numbers(1e4) on node Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance [gw1] PASSED test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables Executing query select 20 on node Executing query select 20 on node Executing query optimize table data final on node Executing query optimize table data final on node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/sys/mutations' on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/sys/mutations' on node Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['zookeeper', 'clickhouse'] Received response(xid=1): ['zookeeper', 'clickhouse'] Sending request(xid=2): Close() Sending request(xid=2): Close() Closing connection to 172.16.4.3:2281 Closing connection to 172.16.4.3:2281 Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo3 get_instance_ip instance_name=zoo3 http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw8-zoo3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw8-zoo3-1/json HTTP/1.1" 200 None get_kazoo_client: zoo3, ip:172.16.4.4, port:2281, use_ssl:True get_kazoo_client: zoo3, ip:172.16.4.4, port:2281, use_ssl:True Connecting to 172.16.4.4(172.16.4.4):2281, use_ssl: True Connecting to 172.16.4.4(172.16.4.4):2281, use_ssl: True Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['zookeeper', 'clickhouse'] Received response(xid=1): ['zookeeper', 'clickhouse'] Sending request(xid=2): Close() Sending request(xid=2): Close() Closing connection to 172.16.4.4:2281 Closing connection to 172.16.4.4:2281 Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED All instances of ZooKeeper started: ['zoo1', 'zoo2', 'zoo3'] All instances of ZooKeeper started: ['zoo1', 'zoo2', 'zoo3'] run container_id:roottestreloadclientcertificate-gw8-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo -n > /var/log/clickhouse-server/clickhouse-server.log'] run container_id:roottestreloadclientcertificate-gw8-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo -n > /var/log/clickhouse-server/clickhouse-server.log'] Command:[docker exec roottestreloadclientcertificate-gw8-node1-1 bash -c echo -n > /var/log/clickhouse-server/clickhouse-server.log] Command:[docker exec roottestreloadclientcertificate-gw8-node1-1 bash -c echo -n > /var/log/clickhouse-server/clickhouse-server.log] Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance run container_id:roottestreloadclientcertificate-gw8-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo -n > /var/log/clickhouse-server/clickhouse-server.log'] run container_id:roottestreloadclientcertificate-gw8-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo -n > /var/log/clickhouse-server/clickhouse-server.log'] Command:[docker exec roottestreloadclientcertificate-gw8-node2-1 bash -c echo -n > /var/log/clickhouse-server/clickhouse-server.log] Command:[docker exec roottestreloadclientcertificate-gw8-node2-1 bash -c echo -n > /var/log/clickhouse-server/clickhouse-server.log] Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/sys/mutations' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/sys/mutations' on node run container_id:roottestreloadclientcertificate-gw8-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF\n\n \n \n /etc/clickhouse-server/config.d/second_client.crt\n /etc/clickhouse-server/config.d/second_client.key\n true\n true\n sslv2,sslv3\n true\n none\n \n RejectCertificateHandler\n \n \n \n\nEOF'] run container_id:roottestreloadclientcertificate-gw8-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF\n\n \n \n /etc/clickhouse-server/config.d/second_client.crt\n /etc/clickhouse-server/config.d/second_client.key\n true\n true\n sslv2,sslv3\n true\n none\n \n RejectCertificateHandler\n \n \n \n\nEOF'] Command:[docker exec roottestreloadclientcertificate-gw8-node1-1 bash -c cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF /etc/clickhouse-server/config.d/second_client.crt /etc/clickhouse-server/config.d/second_client.key true true sslv2,sslv3 true none RejectCertificateHandler EOF] Command:[docker exec roottestreloadclientcertificate-gw8-node1-1 bash -c cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF /etc/clickhouse-server/config.d/second_client.crt /etc/clickhouse-server/config.d/second_client.key true true sslv2,sslv3 true none RejectCertificateHandler EOF] Executing query select 20 on node Executing query select 20 on node run container_id:roottestreloadclientcertificate-gw8-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'touch /etc/clickhouse-server/config.d/ssl_conf.xml'] run container_id:roottestreloadclientcertificate-gw8-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'touch /etc/clickhouse-server/config.d/ssl_conf.xml'] Command:[docker exec roottestreloadclientcertificate-gw8-node1-1 bash -c touch /etc/clickhouse-server/config.d/ssl_conf.xml] Command:[docker exec roottestreloadclientcertificate-gw8-node1-1 bash -c touch /etc/clickhouse-server/config.d/ssl_conf.xml] Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance run container_id:roottestreloadclientcertificate-gw8-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF\n\n \n \n /etc/clickhouse-server/config.d/second_client.crt\n /etc/clickhouse-server/config.d/second_client.key\n true\n true\n sslv2,sslv3\n true\n none\n \n RejectCertificateHandler\n \n \n \n\nEOF'] run container_id:roottestreloadclientcertificate-gw8-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF\n\n \n \n /etc/clickhouse-server/config.d/second_client.crt\n /etc/clickhouse-server/config.d/second_client.key\n true\n true\n sslv2,sslv3\n true\n none\n \n RejectCertificateHandler\n \n \n \n\nEOF'] Command:[docker exec roottestreloadclientcertificate-gw8-node2-1 bash -c cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF /etc/clickhouse-server/config.d/second_client.crt /etc/clickhouse-server/config.d/second_client.key true true sslv2,sslv3 true none RejectCertificateHandler EOF] Command:[docker exec roottestreloadclientcertificate-gw8-node2-1 bash -c cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF /etc/clickhouse-server/config.d/second_client.crt /etc/clickhouse-server/config.d/second_client.key true true sslv2,sslv3 true none RejectCertificateHandler EOF] run container_id:roottestreloadclientcertificate-gw8-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'touch /etc/clickhouse-server/config.d/ssl_conf.xml'] run container_id:roottestreloadclientcertificate-gw8-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'touch /etc/clickhouse-server/config.d/ssl_conf.xml'] Command:[docker exec roottestreloadclientcertificate-gw8-node2-1 bash -c touch /etc/clickhouse-server/config.d/ssl_conf.xml] Command:[docker exec roottestreloadclientcertificate-gw8-node2-1 bash -c touch /etc/clickhouse-server/config.d/ssl_conf.xml] Executing query alter table data update key = 1 where key = 42 on node Executing query alter table data update key = 1 where key = 42 on node test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables [gw4] PASSED test_rocksdb_options/test.py::test_invalid_options Executing query INSERT INTO `postgres_database`.postgresql_replica_0 SELECT number, number from numbers(50) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_0 SELECT number, number from numbers(50) on instance test_rocksdb_options/test.py::test_table_invalid_block_based_table_options run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/format_version/no_such_table_block_based_table_options/g' /etc/clickhouse-server/config.d/rocksdb.xml"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/format_version/no_such_table_block_based_table_options/g' /etc/clickhouse-server/config.d/rocksdb.xml"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c sed -i 's/format_version/no_such_table_block_based_table_options/g' /etc/clickhouse-server/config.d/rocksdb.xml] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c sed -i 's/format_version/no_such_table_block_based_table_options/g' /etc/clickhouse-server/config.d/rocksdb.xml] http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c ps -C clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c ps -C clickhouse] http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Executing query optimize table data final on node Executing query optimize table data final on node Stdout: PID TTY TIME CMD Stdout: PID TTY TIME CMD Stdout: 4651 ? 00:00:04 clickhouse Stdout: 4651 ? 00:00:04 clickhouse run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c pkill clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c pkill clickhouse] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:4651 Stdout:4651 Executing query INSERT INTO `postgres_database`.postgresql_replica_1 SELECT number, number from numbers(50) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_1 SELECT number, number from numbers(50) on instance Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/sys/mutations' on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/sys/mutations' on node Starting zookeeper node: zoo2 Starting zookeeper node: zoo2 Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml start zoo2] Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml start zoo2] Executing query INSERT INTO `postgres_database`.postgresql_replica_2 SELECT number, number from numbers(50) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_2 SELECT number, number from numbers(50) on instance Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/sys/mutations' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/sys/mutations' on node Executing query INSERT INTO `postgres_database`.postgresql_replica_3 SELECT number, number from numbers(50) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_3 SELECT number, number from numbers(50) on instance Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Starting Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Starting Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Started Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Started Starting zookeeper node: zoo3 Starting zookeeper node: zoo3 Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml start zoo3] Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml start zoo3] Executing query INSERT INTO `postgres_database`.postgresql_replica_4 SELECT number, number from numbers(50) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_4 SELECT number, number from numbers(50) on instance Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node [gw3] PASSED test_scheduler/test.py::test_mutate_workload test_scheduler/test.py::test_mutation_workload_change http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:4651 Stdout:4651 run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] Executing query INSERT INTO `postgres_database`.postgresql_replica_5 SELECT number, number from numbers(50) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_5 SELECT number, number from numbers(50) on instance run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Executing query system reload config on node Executing query system reload config on node Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Starting Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Starting Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Started Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Started get_instance_ip instance_name=zoo2 get_instance_ip instance_name=zoo2 http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-zoo2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-zoo2-1/json HTTP/1.1" 200 None get_kazoo_client: zoo2, ip:172.16.9.2, port:2181, use_ssl:False get_kazoo_client: zoo2, ip:172.16.9.2, port:2181, use_ssl:False Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query INSERT INTO `postgres_database`.postgresql_replica_6 SELECT number, number from numbers(50) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_6 SELECT number, number from numbers(50) on instance Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query drop table if exists data; create table data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3'; on node Executing query drop table if exists data; create table data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3'; on node Executing query INSERT INTO `postgres_database`.postgresql_replica_7 SELECT number, number from numbers(50) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_7 SELECT number, number from numbers(50) on instance http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Stderr: zoo1 Skipped - Image is already being pulled by node1 Stderr: zoo1 Skipped - Image is already being pulled by node1 Stderr: zoo2 Skipped - Image is already being pulled by node1 Stderr: zoo2 Skipped - Image is already being pulled by node1 Stderr: zoo3 Skipped - Image is already being pulled by node1 Stderr: zoo3 Skipped - Image is already being pulled by node1 Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: proxy1 Pulling Stderr: proxy1 Pulling Stderr: node1 Pulling Stderr: node1 Pulling Stderr: resolver Pulling Stderr: resolver Pulling Stderr: minio1 Pulling Stderr: minio1 Pulling Stderr: minio1 Pulled Stderr: minio1 Pulled Stderr: proxy1 Pulled Stderr: proxy1 Pulled Stderr: resolver Pulled Stderr: resolver Pulled Stderr: node1 Pulled Stderr: node1 Pulled Setup ZooKeeper Setup ZooKeeper Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/keeper1/log', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/keeper1/config', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/keeper1/coordination', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/keeper2/log', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/keeper2/config', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/keeper2/coordination', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/keeper3/log', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/keeper3/config', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/keeper3/coordination'] Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/keeper1/log', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/keeper1/config', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/keeper1/coordination', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/keeper2/log', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/keeper2/config', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/keeper2/coordination', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/keeper3/log', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/keeper3/config', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/keeper3/coordination'] Command:[docker compose --project-name roottestreplicateds3zerocopydroppartition-gw9 --env-file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Command:[docker compose --project-name roottestreplicateds3zerocopydroppartition-gw9 --env-file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', "echo 'prod_mutations' > /etc/clickhouse-server/config.d/workloads.xml"] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', "echo 'prod_mutations' > /etc/clickhouse-server/config.d/workloads.xml"] Command:[docker exec roottestscheduler-gw3-node-1 bash -c echo 'prod_mutations' > /etc/clickhouse-server/config.d/workloads.xml] Command:[docker exec roottestscheduler-gw3-node-1 bash -c echo 'prod_mutations' > /etc/clickhouse-server/config.d/workloads.xml] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query system reload config on node Executing query system reload config on node Executing query INSERT INTO `postgres_database`.postgresql_replica_8 SELECT number, number from numbers(50) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_8 SELECT number, number from numbers(50) on instance Stdout:4651 Stdout:4651 Executing query INSERT INTO `postgres_database`.postgresql_replica_9 SELECT number, number from numbers(50) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_9 SELECT number, number from numbers(50) on instance Executing query insert into data select * from numbers(1e4) on node Executing query insert into data select * from numbers(1e4) on node Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query DROP DATABASE IF EXISTS `test_database` on instance Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query optimize table data final on node Executing query optimize table data final on node Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster RENAME COLUMN foo2 to foo3 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster RENAME COLUMN foo2 to foo3 on node1 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') SETTINGS materialized_postgresql_tables_list = 'postgresql_replica_0, postgresql_replica_1, postgresql_replica_2, postgresql_replica_3, postgresql_replica_4' on instance Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') SETTINGS materialized_postgresql_tables_list = 'postgresql_replica_0, postgresql_replica_1, postgresql_replica_2, postgresql_replica_3, postgresql_replica_4' on instance Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/prod_mutations' on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/prod_mutations' on node Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster RENAME COLUMN foo3 to num2 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster RENAME COLUMN foo3 to num2 on node1 Stdout:4651 Stdout:4651 Stderr:time="2025-04-02T02:53:34Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:53:34Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottestreplicateds3zerocopydroppartition-gw9_default Creating Stderr: Network roottestreplicateds3zerocopydroppartition-gw9_default Creating Stderr: Network roottestreplicateds3zerocopydroppartition-gw9_default Created Stderr: Network roottestreplicateds3zerocopydroppartition-gw9_default Created Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo1-1 Creating Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo1-1 Creating Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo2-1 Creating Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo2-1 Creating Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo3-1 Creating Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo3-1 Creating Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo2-1 Created Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo2-1 Created Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo3-1 Created Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo3-1 Created Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo1-1 Created Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo1-1 Created Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo2-1 Starting Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo2-1 Starting Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo3-1 Starting Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo3-1 Starting Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo1-1 Starting Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo1-1 Starting Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo2-1 Started Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo2-1 Started Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo1-1 Started Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo1-1 Started Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo3-1 Started Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo3-1 Started Stderr:time="2025-04-02T02:53:35Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:53:35Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:53:35Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:53:35Z" level=debug msg="otel error" error="" Wait ZooKeeper to start Wait ZooKeeper to start get_instance_ip instance_name=zoo1 get_instance_ip instance_name=zoo1 http://localhost:None "GET /v1.46/containers/roottestreplicateds3zerocopydroppartition-gw9-zoo1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateds3zerocopydroppartition-gw9-zoo1-1/json HTTP/1.1" 200 None get_kazoo_client: zoo1, ip:172.16.7.4, port:2181, use_ssl:False get_kazoo_client: zoo1, ip:172.16.7.4, port:2181, use_ssl:False Connecting to 172.16.7.4(172.16.7.4):2181, use_ssl: False Connecting to 172.16.7.4(172.16.7.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query SHOW DATABASES on instance Executing query SHOW DATABASES on instance Connecting to 172.16.7.4(172.16.7.4):2181, use_ssl: False Connecting to 172.16.7.4(172.16.7.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/prod_mutations' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/prod_mutations' on node Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster RENAME COLUMN foo2 to foo3 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster RENAME COLUMN foo2 to foo3 on node1 Connecting to 172.16.7.4(172.16.7.4):2181, use_ssl: False Connecting to 172.16.7.4(172.16.7.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query alter table data update key = 1 where key = 42 on node Executing query alter table data update key = 1 where key = 42 on node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None Connecting to 172.16.7.4(172.16.7.4):2181, use_ssl: False Connecting to 172.16.7.4(172.16.7.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Executing query optimize table data final on node Executing query optimize table data final on node run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/prod_mutations' on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/prod_mutations' on node No clickhouse process running. Start new one. No clickhouse process running. Start new one. http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw4-node-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw4-node-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/0d130025588b250362f7da4fd9b9e514a7e907d2e12c363919cb64f838eb4fe4/start HTTP/1.1" 200 0 http://localhost:None "POST /v1.46/exec/0d130025588b250362f7da4fd9b9e514a7e907d2e12c363919cb64f838eb4fe4/start HTTP/1.1" 200 0 http://localhost:None "GET /v1.46/exec/0d130025588b250362f7da4fd9b9e514a7e907d2e12c363919cb64f838eb4fe4/json HTTP/1.1" 200 586 http://localhost:None "GET /v1.46/exec/0d130025588b250362f7da4fd9b9e514a7e907d2e12c363919cb64f838eb4fe4/json HTTP/1.1" 200 586 Connecting to 172.16.7.4(172.16.7.4):2181, use_ssl: False Connecting to 172.16.7.4(172.16.7.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/prod_mutations' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/prod_mutations' on node Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', "echo 'dev_mutations' > /etc/clickhouse-server/config.d/workloads.xml"] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', "echo 'dev_mutations' > /etc/clickhouse-server/config.d/workloads.xml"] Command:[docker exec roottestscheduler-gw3-node-1 bash -c echo 'dev_mutations' > /etc/clickhouse-server/config.d/workloads.xml] Command:[docker exec roottestscheduler-gw3-node-1 bash -c echo 'dev_mutations' > /etc/clickhouse-server/config.d/workloads.xml] Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query system reload config on node Executing query system reload config on node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Connecting to 172.16.7.4(172.16.7.4):2181, use_ssl: False Connecting to 172.16.7.4(172.16.7.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query insert into data select * from numbers(1e4) on node Executing query insert into data select * from numbers(1e4) on node Executing query SELECT * FROM `test_database`.`postgresql_replica_1` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_1` LIMIT 1 FORMAT Null on instance run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:5441 Stdout:5441 Clickhouse process running. Clickhouse process running. run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:5441 Stdout:5441 Executing query select 20 on node Executing query select 20 on node Executing query optimize table data final on node Executing query optimize table data final on node Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_1' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_1' on instance http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/dev_mutations' on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/dev_mutations' on node Executing query SELECT * FROM `test_database`.`postgresql_replica_2` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_2` LIMIT 1 FORMAT Null on instance Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/dev_mutations' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/dev_mutations' on node Connecting to 172.16.7.4(172.16.7.4):2181, use_ssl: False Connecting to 172.16.7.4(172.16.7.4):2181, use_ssl: False Executing query select 20 on node Executing query select 20 on node Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo2 get_instance_ip instance_name=zoo2 http://localhost:None "GET /v1.46/containers/roottestreplicateds3zerocopydroppartition-gw9-zoo2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateds3zerocopydroppartition-gw9-zoo2-1/json HTTP/1.1" 200 None get_kazoo_client: zoo2, ip:172.16.7.2, port:2181, use_ssl:False get_kazoo_client: zoo2, ip:172.16.7.2, port:2181, use_ssl:False Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_2' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_2' on instance Connecting to 172.16.7.2(172.16.7.2):2181, use_ssl: False Connecting to 172.16.7.2(172.16.7.2):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo3 get_instance_ip instance_name=zoo3 Executing query alter table data update key = 1 where key = 42 on node Executing query alter table data update key = 1 where key = 42 on node http://localhost:None "GET /v1.46/containers/roottestreplicateds3zerocopydroppartition-gw9-zoo3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateds3zerocopydroppartition-gw9-zoo3-1/json HTTP/1.1" 200 None get_kazoo_client: zoo3, ip:172.16.7.3, port:2181, use_ssl:False get_kazoo_client: zoo3, ip:172.16.7.3, port:2181, use_ssl:False Connecting to 172.16.7.3(172.16.7.3):2181, use_ssl: False Connecting to 172.16.7.3(172.16.7.3):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') Trying to create Minio instance by command docker compose --project-name roottestreplicateds3zerocopydroppartition-gw9 --env-file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Trying to create Minio instance by command docker compose --project-name roottestreplicateds3zerocopydroppartition-gw9 --env-file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Command:[docker compose --project-name roottestreplicateds3zerocopydroppartition-gw9 --env-file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Command:[docker compose --project-name roottestreplicateds3zerocopydroppartition-gw9 --env-file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Executing query SELECT * FROM `test_database`.`postgresql_replica_3` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_3` LIMIT 1 FORMAT Null on instance Executing query optimize table data final on node Executing query optimize table data final on node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_3' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_3' on instance Executing query select 20 on node Executing query select 20 on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/dev_mutations' on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/dev_mutations' on node Executing query SELECT * FROM `test_database`.`postgresql_replica_4` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_4` LIMIT 1 FORMAT Null on instance Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/dev_mutations' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/dev_mutations' on node Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_4' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_4' on instance Executing query select 20 on node Executing query select 20 on node Executing query SELECT count() FROM system.tables WHERE database = 'test_database'; on instance Executing query SELECT count() FROM system.tables WHERE database = 'test_database'; on instance http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None [gw3] PASSED test_scheduler/test.py::test_mutation_workload_change http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None test_scheduler/test.py::test_mutation_workload_override http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query SHOW TABLES FROM test_database on instance Executing query SHOW TABLES FROM test_database on instance Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB PRIMARY KEY(key); on node Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB PRIMARY KEY(key); on node run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Executing query system reload config on node Executing query system reload config on node Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper', 'clickhouse'] Received response(xid=1): ['keeper', 'clickhouse'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Executing query INSERT INTO postgres_database.postgresql_replica_0 SELECT 50 + number, 0 from numbers(100) on instance Executing query INSERT INTO postgres_database.postgresql_replica_0 SELECT 50 + number, 0 from numbers(100) on instance Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo3 get_instance_ip instance_name=zoo3 http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-zoo3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-zoo3-1/json HTTP/1.1" 200 None get_kazoo_client: zoo3, ip:172.16.9.3, port:2181, use_ssl:False get_kazoo_client: zoo3, ip:172.16.9.3, port:2181, use_ssl:False Connecting to 172.16.9.3(172.16.9.3):2181, use_ssl: False Connecting to 172.16.9.3(172.16.9.3):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper', 'clickhouse'] Received response(xid=1): ['keeper', 'clickhouse'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED All instances of ZooKeeper started: ['zoo2', 'zoo3'] All instances of ZooKeeper started: ['zoo2', 'zoo3'] Executing query SELECT name FROM system.functions WHERE name IN ['f1', 'f2', 'f3'] ORDER BY name on node2 Executing query SELECT name FROM system.functions WHERE name IN ['f1', 'f2', 'f3'] ORDER BY name on node2 [gw6] PASSED test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy Executing query INSERT INTO FUNCTION s3('http://minio1:9001/root/data/remote_proxy_node/test.csv', 'minio', 'minio123', 'CSV', 'key String, value String') VALUES ('color','red'),('size','10') on remote_proxy_node Executing query INSERT INTO FUNCTION s3('http://minio1:9001/root/data/remote_proxy_node/test.csv', 'minio', 'minio123', 'CSV', 'key String, value String') VALUES ('color','red'),('size','10') on remote_proxy_node Stderr:time="2025-04-02T02:53:38Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:53:38Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Volume "roottestreplicateds3zerocopydroppartition-gw9_data1-1" Creating Stderr: Volume "roottestreplicateds3zerocopydroppartition-gw9_data1-1" Creating Stderr: Volume "roottestreplicateds3zerocopydroppartition-gw9_data1-1" Created Stderr: Volume "roottestreplicateds3zerocopydroppartition-gw9_data1-1" Created Stderr:time="2025-04-02T02:53:39Z" level=warning msg="Found orphan containers ([roottestreplicateds3zerocopydroppartition-gw9-zoo3-1 roottestreplicateds3zerocopydroppartition-gw9-zoo1-1 roottestreplicateds3zerocopydroppartition-gw9-zoo2-1]) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up." Stderr:time="2025-04-02T02:53:39Z" level=warning msg="Found orphan containers ([roottestreplicateds3zerocopydroppartition-gw9-zoo3-1 roottestreplicateds3zerocopydroppartition-gw9-zoo1-1 roottestreplicateds3zerocopydroppartition-gw9-zoo2-1]) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up." Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-proxy1-1 Creating Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-proxy1-1 Creating Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-proxy2-1 Creating Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-proxy2-1 Creating Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-proxy2-1 Created Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-proxy2-1 Created Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-proxy1-1 Created Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-proxy1-1 Created Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-minio1-1 Creating Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-minio1-1 Creating Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-resolver-1 Creating Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-resolver-1 Creating Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-resolver-1 Created Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-resolver-1 Created Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-minio1-1 Created Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-minio1-1 Created Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-proxy2-1 Starting Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-proxy2-1 Starting Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-proxy1-1 Starting Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-proxy1-1 Starting Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-proxy1-1 Started Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-proxy1-1 Started Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-proxy2-1 Started Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-proxy2-1 Started Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-resolver-1 Starting Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-resolver-1 Starting Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-minio1-1 Starting Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-minio1-1 Starting Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-minio1-1 Started Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-minio1-1 Started Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-resolver-1 Started Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-resolver-1 Started Stderr:time="2025-04-02T02:53:41Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:53:41Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:53:41Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:53:41Z" level=debug msg="otel error" error="" Trying to connect to Minio... Trying to connect to Minio... get_instance_ip instance_name=minio1 get_instance_ip instance_name=minio1 http://localhost:None "GET /v1.46/containers/roottestreplicateds3zerocopydroppartition-gw9-minio1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateds3zerocopydroppartition-gw9-minio1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=proxy1 get_instance_ip instance_name=proxy1 http://localhost:None "GET /v1.46/containers/roottestreplicateds3zerocopydroppartition-gw9-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateds3zerocopydroppartition-gw9-proxy1-1/json HTTP/1.1" 200 None Starting new HTTP connection (1): 172.16.7.8:9001 Starting new HTTP connection (1): 172.16.7.8:9001 Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (2): 172.16.7.8:9001 Starting new HTTP connection (2): 172.16.7.8:9001 Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (3): 172.16.7.8:9001 Starting new HTTP connection (3): 172.16.7.8:9001 Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (4): 172.16.7.8:9001 Starting new HTTP connection (4): 172.16.7.8:9001 Can't connect to Minio: HTTPConnectionPool(host='172.16.7.8', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Can't connect to Minio: HTTPConnectionPool(host='172.16.7.8', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/no_such_table_block_based_table_options/format_version/g' /etc/clickhouse-server/config.d/rocksdb.xml"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/no_such_table_block_based_table_options/format_version/g' /etc/clickhouse-server/config.d/rocksdb.xml"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c sed -i 's/no_such_table_block_based_table_options/format_version/g' /etc/clickhouse-server/config.d/rocksdb.xml] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c sed -i 's/no_such_table_block_based_table_options/format_version/g' /etc/clickhouse-server/config.d/rocksdb.xml] Executing query INSERT INTO postgres_database.postgresql_replica_1 SELECT 50 + number, 1 from numbers(100) on instance Executing query INSERT INTO postgres_database.postgresql_replica_1 SELECT 50 + number, 1 from numbers(100) on instance grep in log called Reloaded certificate (/etc/clickhouse-server/config.d/second_client.crt) grep in log called Reloaded certificate (/etc/clickhouse-server/config.d/second_client.crt) run container_id:roottestreloadclientcertificate-gw8-node1-1 detach:False nothrow:False cmd: ['bash', '-c', '[ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -a "Reloaded certificate (/etc/clickhouse-server/config.d/second_client.crt)" /var/log/clickhouse-server/clickhouse-server.log* || true'] run container_id:roottestreloadclientcertificate-gw8-node1-1 detach:False nothrow:False cmd: ['bash', '-c', '[ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -a "Reloaded certificate (/etc/clickhouse-server/config.d/second_client.crt)" /var/log/clickhouse-server/clickhouse-server.log* || true'] Command:[docker exec roottestreloadclientcertificate-gw8-node1-1 bash -c [ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -a "Reloaded certificate (/etc/clickhouse-server/config.d/second_client.crt)" /var/log/clickhouse-server/clickhouse-server.log* || true] Command:[docker exec roottestreloadclientcertificate-gw8-node1-1 bash -c [ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -a "Reloaded certificate (/etc/clickhouse-server/config.d/second_client.crt)" /var/log/clickhouse-server/clickhouse-server.log* || true] Executing query drop table if exists prod_data; drop table if exists dev_data; create table prod_data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3', mutation_workload='prod_mutations'; create table dev_data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3', mutation_workload='dev_mutations'; on node Executing query drop table if exists prod_data; drop table if exists dev_data; create table prod_data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3', mutation_workload='prod_mutations'; create table dev_data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3', mutation_workload='dev_mutations'; on node Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query SELECT * FROM s3('http://minio1:9001/root/data/remote_proxy_node/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on remote_proxy_node Executing query SELECT * FROM s3('http://minio1:9001/root/data/remote_proxy_node/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on remote_proxy_node run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c ps -C clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c ps -C clickhouse] Stdout:2025.04.02 02:53:33.369283 [ 664 ] {} CertificateReloader: Reloaded certificate (/etc/clickhouse-server/config.d/second_client.crt) and key (/etc/clickhouse-server/config.d/second_client.key). Stdout:2025.04.02 02:53:33.369283 [ 664 ] {} CertificateReloader: Reloaded certificate (/etc/clickhouse-server/config.d/second_client.crt) and key (/etc/clickhouse-server/config.d/second_client.key). grep result 2025.04.02 02:53:33.369283 [ 664 ] {} CertificateReloader: Reloaded certificate (/etc/clickhouse-server/config.d/second_client.crt) and key (/etc/clickhouse-server/config.d/second_client.key). grep result 2025.04.02 02:53:33.369283 [ 664 ] {} CertificateReloader: Reloaded certificate (/etc/clickhouse-server/config.d/second_client.crt) and key (/etc/clickhouse-server/config.d/second_client.key). Stopping zookeeper node: zoo1 Executing query INSERT INTO postgres_database.postgresql_replica_2 SELECT 50 + number, 2 from numbers(100) on instance Stopping zookeeper node: zoo1 Executing query INSERT INTO postgres_database.postgresql_replica_2 SELECT 50 + number, 2 from numbers(100) on instance Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo1] Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo1] Stdout: PID TTY TIME CMD Stdout: PID TTY TIME CMD Stdout: 5441 ? 00:00:04 clickhouse Stdout: 5441 ? 00:00:04 clickhouse run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c pkill clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c pkill clickhouse] Executing query CREATE FUNCTION f3 AS (x, y) -> x * y on node1 Executing query CREATE FUNCTION f3 AS (x, y) -> x * y on node1 Executing query insert into prod_data select * from numbers(1e4) on node Executing query insert into prod_data select * from numbers(1e4) on node run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query INSERT INTO postgres_database.postgresql_replica_3 SELECT 50 + number, 3 from numbers(100) on instance Executing query INSERT INTO postgres_database.postgresql_replica_3 SELECT 50 + number, 3 from numbers(100) on instance Stdout:5441 Stdout:5441 Executing query SELECT * FROM s3('http://minio1:9001/root/data/remote_proxy_node/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on remote_proxy_node Executing query SELECT * FROM s3('http://minio1:9001/root/data/remote_proxy_node/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on remote_proxy_node Starting new HTTP connection (5): 172.16.7.8:9001 Starting new HTTP connection (5): 172.16.7.8:9001 Executing query optimize table prod_data final on node Executing query optimize table prod_data final on node http://172.16.7.8:9001 "GET / HTTP/1.1" 200 0 http://172.16.7.8:9001 "GET / HTTP/1.1" 200 0 Connected to Minio. Connected to Minio. http://172.16.7.8:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.7.8:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.7.8:9001 "PUT /root HTTP/1.1" 200 0 http://172.16.7.8:9001 "PUT /root HTTP/1.1" 200 0 S3 bucket 'root' created S3 bucket 'root' created http://172.16.7.8:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.7.8:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.7.8:9001 "PUT /root2 HTTP/1.1" 200 0 http://172.16.7.8:9001 "PUT /root2 HTTP/1.1" 200 0 S3 bucket 'root2' created S3 bucket 'root2' created ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/.env --project-name roottestreplicateds3zerocopydroppartition-gw9 --file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/.env --project-name roottestreplicateds3zerocopydroppartition-gw9 --file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/.env --project-name roottestreplicateds3zerocopydroppartition-gw9 --file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/.env --project-name roottestreplicateds3zerocopydroppartition-gw9 --file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate] Executing query INSERT INTO postgres_database.postgresql_replica_4 SELECT 50 + number, 4 from numbers(100) on instance Executing query INSERT INTO postgres_database.postgresql_replica_4 SELECT 50 + number, 4 from numbers(100) on instance Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query insert into dev_data select * from numbers(1e4) on node Executing query insert into dev_data select * from numbers(1e4) on node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Executing query INSERT INTO postgres_database.postgresql_replica_5 SELECT 50 + number, 5 from numbers(100) on instance Executing query INSERT INTO postgres_database.postgresql_replica_5 SELECT 50 + number, 5 from numbers(100) on instance Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Stopping Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Stopping Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Stopped Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Stopped Stopping zookeeper node: zoo2 Stopping zookeeper node: zoo2 Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo2] Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo2] Executing query optimize table dev_data final on node Executing query optimize table dev_data final on node run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query INSERT INTO postgres_database.postgresql_replica_6 SELECT 50 + number, 6 from numbers(100) on instance Executing query INSERT INTO postgres_database.postgresql_replica_6 SELECT 50 + number, 6 from numbers(100) on instance Stdout:5441 Stdout:5441 Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo2-1 Running Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo2-1 Running Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo3-1 Running Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo3-1 Running Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-proxy1-1 Running Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-proxy1-1 Running Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-proxy2-1 Running Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-proxy2-1 Running Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-resolver-1 Running Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-resolver-1 Running Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo1-1 Running Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo1-1 Running Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-minio1-1 Running Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-minio1-1 Running Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-node1-1 Creating Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-node1-1 Creating Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-node1-1 Created Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-node1-1 Created Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-node1-1 Starting Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-node1-1 Starting Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-node1-1 Started Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-node1-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node1 get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottestreplicateds3zerocopydroppartition-gw9-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateds3zerocopydroppartition-gw9-node1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node1 get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottestreplicateds3zerocopydroppartition-gw9-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateds3zerocopydroppartition-gw9-node1-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node1, ip: 172.16.7.9... Waiting for ClickHouse start in node1, ip: 172.16.7.9... http://localhost:None "GET /v1.46/containers/roottestreplicateds3zerocopydroppartition-gw9-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateds3zerocopydroppartition-gw9-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/prod_mutations' on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/prod_mutations' on node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None Executing query INSERT INTO postgres_database.postgresql_replica_7 SELECT 50 + number, 7 from numbers(100) on instance Executing query INSERT INTO postgres_database.postgresql_replica_7 SELECT 50 + number, 7 from numbers(100) on instance http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None Executing query INSERT INTO postgres_database.postgresql_replica_8 SELECT 50 + number, 8 from numbers(100) on instance Executing query INSERT INTO postgres_database.postgresql_replica_8 SELECT 50 + number, 8 from numbers(100) on instance Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/prod_mutations' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/prod_mutations' on node http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Stopping Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Stopping Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Stopped Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Stopped Stopping zookeeper node: zoo3 Stopping zookeeper node: zoo3 Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo3] Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo3] Executing query INSERT INTO postgres_database.postgresql_replica_9 SELECT 50 + number, 9 from numbers(100) on instance Executing query INSERT INTO postgres_database.postgresql_replica_9 SELECT 50 + number, 9 from numbers(100) on instance http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/dev_mutations' on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/dev_mutations' on node run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Stdout:5441 Stdout:5441 http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/dev_mutations' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/dev_mutations' on node Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None Executing query alter table prod_data update key = 1 where key = 42 on node Executing query alter table prod_data update key = 1 where key = 42 on node Executing query select * from `postgres_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_0` order by key; on instance Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Stopping Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Stopping Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Stopped Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Stopped Starting zookeeper node: zoo1 Starting zookeeper node: zoo1 Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo1] Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo1] http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Executing query optimize table prod_data final on node Executing query optimize table prod_data final on node Stdout:5441 Stdout:5441 http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo \'\n \n \n zoo2\n 2181\n \n 2000\n \n\' > /etc/clickhouse-server/conf.d/zookeeper.xml'] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo \'\n \n \n zoo2\n 2181\n \n 2000\n \n\' > /etc/clickhouse-server/conf.d/zookeeper.xml'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c echo ' zoo2 2181 2000 ' > /etc/clickhouse-server/conf.d/zookeeper.xml] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c echo ' zoo2 2181 2000 ' > /etc/clickhouse-server/conf.d/zookeeper.xml] http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query SYSTEM RELOAD CONFIG on node1 Executing query SYSTEM RELOAD CONFIG on node1 Executing query alter table dev_data update key = 1 where key = 42 on node Executing query alter table dev_data update key = 1 where key = 42 on node Executing query SELECT * FROM `test_database`.`postgresql_replica_1` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_1` LIMIT 1 FORMAT Null on instance http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Starting Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Starting Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Started Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Started Starting zookeeper node: zoo2 Starting zookeeper node: zoo2 Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo2] Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo2] Executing query optimize table dev_data final on node Executing query optimize table dev_data final on node http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_1' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_1' on instance http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7b7317ce73e0cabbfd158f26d82dd63d15bc8df1168e16aed9bf45d1243349f8/json HTTP/1.1" 200 None ClickHouse node1 started ClickHouse node1 started Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/prod_mutations' on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/prod_mutations' on node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None Executing query CREATE TABLE test_local(c1 Int8, c2 Date) ENGINE = ReplicatedMergeTree('/test/tables/shard/test_local', '1') PARTITION BY c2 ORDER BY c2 on node1 Executing query CREATE TABLE test_local(c1 Int8, c2 Date) ENGINE = ReplicatedMergeTree('/test/tables/shard/test_local', '1') PARTITION BY c2 ORDER BY c2 on node1 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query select * from `postgres_database`.`postgresql_replica_1` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_1` order by key; on instance Stdout:5441 Stdout:5441 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Starting Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Starting Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Started Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Started Starting zookeeper node: zoo3 Starting zookeeper node: zoo3 Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo3] Command:[docker compose --project-name roottestreloadclientcertificate-gw8 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo3] Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/prod_mutations' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/prod_mutations' on node Executing query select * from `test_database`.`postgresql_replica_1` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_1` order by key; on instance Executing query CREATE TABLE test_s3(c1 Int8, c2 Date) ENGINE = ReplicatedMergeTree('/test/tables/shard/test_s3', '1') PARTITION BY c2 ORDER BY c2 SETTINGS storage_policy = 's3', allow_remote_fs_zero_copy_replication=0 on node1 Executing query CREATE TABLE test_s3(c1 Int8, c2 Date) ENGINE = ReplicatedMergeTree('/test/tables/shard/test_s3', '1') PARTITION BY c2 ORDER BY c2 SETTINGS storage_policy = 's3', allow_remote_fs_zero_copy_replication=0 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/dev_mutations' on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/dev_mutations' on node Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Starting Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Starting Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Started Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Started run container_id:roottestreloadclientcertificate-gw8-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo -n > /var/log/clickhouse-server/clickhouse-server.log'] run container_id:roottestreloadclientcertificate-gw8-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo -n > /var/log/clickhouse-server/clickhouse-server.log'] Command:[docker exec roottestreloadclientcertificate-gw8-node1-1 bash -c echo -n > /var/log/clickhouse-server/clickhouse-server.log] Command:[docker exec roottestreloadclientcertificate-gw8-node1-1 bash -c echo -n > /var/log/clickhouse-server/clickhouse-server.log] Executing query INSERT INTO test_local VALUES (1, '2023-10-04'), (2, '2023-10-04') on node1 Executing query INSERT INTO test_local VALUES (1, '2023-10-04'), (2, '2023-10-04') on node1 Executing query SELECT * FROM `test_database`.`postgresql_replica_2` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_2` LIMIT 1 FORMAT Null on instance http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/dev_mutations' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/dev_mutations' on node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster RENAME COLUMN foo2 to num2 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster RENAME COLUMN foo2 to num2 on node1 run container_id:roottestreloadclientcertificate-gw8-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo -n > /var/log/clickhouse-server/clickhouse-server.log'] run container_id:roottestreloadclientcertificate-gw8-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo -n > /var/log/clickhouse-server/clickhouse-server.log'] Command:[docker exec roottestreloadclientcertificate-gw8-node2-1 bash -c echo -n > /var/log/clickhouse-server/clickhouse-server.log] Command:[docker exec roottestreloadclientcertificate-gw8-node2-1 bash -c echo -n > /var/log/clickhouse-server/clickhouse-server.log] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] get_instance_ip instance_name=zoo1 get_instance_ip instance_name=zoo1 run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw8-zoo1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw8-zoo1-1/json HTTP/1.1" 200 None get_kazoo_client: zoo1, ip:172.16.4.2, port:2281, use_ssl:True get_kazoo_client: zoo1, ip:172.16.4.2, port:2281, use_ssl:True Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Connecting to 172.16.4.2(172.16.4.2):2281, use_ssl: True Connecting to 172.16.4.2(172.16.4.2):2281, use_ssl: True Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_2' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_2' on instance Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node [gw3] PASSED test_scheduler/test.py::test_mutation_workload_override test_scheduler/test.py::test_resource_any_disk No clickhouse process running. Start new one. No clickhouse process running. Start new one. Executing query SELECT count() FROM test_local on node1 Executing query SELECT count() FROM test_local on node1 http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw4-node-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw4-node-1/exec HTTP/1.1" 201 74 run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo \'\n \n \n zoo2\n 2181\n \n 2000\n \n\' > /etc/clickhouse-server/conf.d/zookeeper.xml'] run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo \'\n \n \n zoo2\n 2181\n \n 2000\n \n\' > /etc/clickhouse-server/conf.d/zookeeper.xml'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c echo ' zoo2 2181 2000 ' > /etc/clickhouse-server/conf.d/zookeeper.xml] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c echo ' zoo2 2181 2000 ' > /etc/clickhouse-server/conf.d/zookeeper.xml] Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster RENAME COLUMN foo2 to num2 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster RENAME COLUMN foo2 to num2 on node1 Connecting to 172.16.4.2(172.16.4.2):2281, use_ssl: True Connecting to 172.16.4.2(172.16.4.2):2281, use_ssl: True Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "POST /v1.46/exec/ad37d1b6eb2d416c4eabdb28654b286fa34752cba35a42f7988e0824b8d023bd/start HTTP/1.1" 200 0 http://localhost:None "POST /v1.46/exec/ad37d1b6eb2d416c4eabdb28654b286fa34752cba35a42f7988e0824b8d023bd/start HTTP/1.1" 200 0 http://localhost:None "GET /v1.46/exec/ad37d1b6eb2d416c4eabdb28654b286fa34752cba35a42f7988e0824b8d023bd/json HTTP/1.1" 200 586 http://localhost:None "GET /v1.46/exec/ad37d1b6eb2d416c4eabdb28654b286fa34752cba35a42f7988e0824b8d023bd/json HTTP/1.1" 200 586 Executing query SYSTEM RELOAD CONFIG on node2 Executing query SYSTEM RELOAD CONFIG on node2 run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] Connecting to 172.16.4.2(172.16.4.2):2281, use_ssl: True Connecting to 172.16.4.2(172.16.4.2):2281, use_ssl: True Executing query select * from `postgres_database`.`postgresql_replica_2` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_2` order by key; on instance run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Executing query system reload config on node Executing query system reload config on node Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster RENAME COLUMN foo3 to num2 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster RENAME COLUMN foo3 to num2 on node1 http://172.16.7.8:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 http://172.16.7.8:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 Executing query ALTER TABLE test_s3 FETCH PARTITION '2023-10-04' FROM '/test/tables/shard/test_local' on node1 Executing query ALTER TABLE test_s3 FETCH PARTITION '2023-10-04' FROM '/test/tables/shard/test_local' on node1 Executing query select * from `test_database`.`postgresql_replica_2` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_2` order by key; on instance Executing query drop table if exists data; create table data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3_no_resource'; on node Executing query drop table if exists data; create table data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3_no_resource'; on node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster RENAME COLUMN foo3 to num2 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster RENAME COLUMN foo3 to num2 on node1 Executing query ALTER TABLE test_s3 DROP DETACHED PARTITION '2023-10-04' SETTINGS allow_drop_detached = 1 on node1 Executing query ALTER TABLE test_s3 DROP DETACHED PARTITION '2023-10-04' SETTINGS allow_drop_detached = 1 on node1 Executing query create resource io (write any disk, read any disk); create workload all settings max_cost = 1000000; on node Executing query create resource io (write any disk, read any disk); create workload all settings max_cost = 1000000; on node Executing query SELECT * FROM `test_database`.`postgresql_replica_3` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_3` LIMIT 1 FORMAT Null on instance Executing query insert into data select * from numbers(1e5) settings workload='all' on node Executing query insert into data select * from numbers(1e5) settings workload='all' on node run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] http://172.16.7.8:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 http://172.16.7.8:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 Executing query DROP TABLE test_local SYNC on node1 Executing query DROP TABLE test_local SYNC on node1 Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_3' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_3' on instance Stdout:6251 Stdout:6251 Clickhouse process running. Clickhouse process running. run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['ss', '--resolve', '--tcp', '--no-header', 'state', 'ESTABLISHED', '( dport = 2181 or sport = 2181 )'] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['ss', '--resolve', '--tcp', '--no-header', 'state', 'ESTABLISHED', '( dport = 2181 or sport = 2181 )'] Command:[docker exec -u root --privileged roottestreplicateduserdefinedfunctions-gw2-node1-1 ss --resolve --tcp --no-header state ESTABLISHED ( dport = 2181 or sport = 2181 )] Command:[docker exec -u root --privileged roottestreplicateduserdefinedfunctions-gw2-node1-1 ss --resolve --tcp --no-header state ESTABLISHED ( dport = 2181 or sport = 2181 )] Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Stdout:0 0 node1:55860 roottestreplicateduserdefinedfunctions-gw2-zoo2-1.roottestreplicateduserdefinedfunctions-gw2_default:2181 Stdout:0 0 node1:55860 roottestreplicateduserdefinedfunctions-gw2-zoo2-1.roottestreplicateduserdefinedfunctions-gw2_default:2181 Executing query CREATE FUNCTION f3 AS (x, y) -> x / y on node1 Executing query CREATE FUNCTION f3 AS (x, y) -> x / y on node1 Stdout:6251 Stdout:6251 Executing query select 20 on node Executing query select 20 on node Executing query select dequeued_requests>0 from system.scheduler where resource='io' and path ilike '%/all/%' and type='fifo' on node Executing query select dequeued_requests>0 from system.scheduler where resource='io' and path ilike '%/all/%' and type='fifo' on node Executing query select * from `postgres_database`.`postgresql_replica_3` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_3` order by key; on instance Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Executing query DROP TABLE test_s3 SYNC on node1 Executing query DROP TABLE test_s3 SYNC on node1 Connection dropped: socket connection broken Connection dropped: socket connection broken Executing query SELECT name FROM system.functions WHERE name IN ['f1', 'f2', 'f3'] ORDER BY name on node2 Executing query SELECT name FROM system.functions WHERE name IN ['f1', 'f2', 'f3'] ORDER BY name on node2 Executing query select sum(key*key) from data settings workload='all' on node Executing query select sum(key*key) from data settings workload='all' on node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None Executing query select * from `test_database`.`postgresql_replica_3` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_3` order by key; on instance http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 [gw9] PASSED test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns Executing query CREATE TABLE warming_up( id Int8 ) ENGINE = MergeTree order by (id) SETTINGS storage_policy = 's3'; on node1 Executing query CREATE TABLE warming_up( id Int8 ) ENGINE = MergeTree order by (id) SETTINGS storage_policy = 's3'; on node1 Connecting to 172.16.4.2(172.16.4.2):2281, use_ssl: True Connecting to 172.16.4.2(172.16.4.2):2281, use_ssl: True Executing query SELECT * FROM `test_database`.`postgresql_replica_4` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_4` LIMIT 1 FORMAT Null on instance Executing query select 20 on node Executing query select 20 on node Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) http://172.16.7.8:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 http://172.16.7.8:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 Executing query CREATE TABLE test_s3_complex_types( c1 Int8, c2 Date, `c3.k` Array(String), `c3.v1` Array(Int64), `c3.v3` Array(Int64), `c3.v4` Array(Int64) ) ENGINE = MergeTree order by (c1,c2) SETTINGS storage_policy = 's3', min_bytes_for_wide_part=1, vertical_merge_algorithm_min_rows_to_activate=1, vertical_merge_algorithm_min_columns_to_activate=1; on node1 Executing query CREATE TABLE test_s3_complex_types( c1 Int8, c2 Date, `c3.k` Array(String), `c3.v1` Array(Int64), `c3.v3` Array(Int64), `c3.v4` Array(Int64) ) ENGINE = MergeTree order by (c1,c2) SETTINGS storage_policy = 's3', min_bytes_for_wide_part=1, vertical_merge_algorithm_min_rows_to_activate=1, vertical_merge_algorithm_min_columns_to_activate=1; on node1 Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Executing query select dequeued_requests>0 from system.scheduler where resource='io' and path ilike '%/all/%' and type='fifo' on node Executing query select dequeued_requests>0 from system.scheduler where resource='io' and path ilike '%/all/%' and type='fifo' on node Received response(xid=1): ['zookeeper', 'clickhouse'] Received response(xid=1): ['zookeeper', 'clickhouse'] Sending request(xid=2): Close() Sending request(xid=2): Close() Closing connection to 172.16.4.2:2281 Closing connection to 172.16.4.2:2281 Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo2 get_instance_ip instance_name=zoo2 http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw8-zoo2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw8-zoo2-1/json HTTP/1.1" 200 None get_kazoo_client: zoo2, ip:172.16.4.3, port:2281, use_ssl:True get_kazoo_client: zoo2, ip:172.16.4.3, port:2281, use_ssl:True Connecting to 172.16.4.3(172.16.4.3):2281, use_ssl: True Connecting to 172.16.4.3(172.16.4.3):2281, use_ssl: True Executing query SELECT name FROM system.functions WHERE name IN ['f1', 'f2', 'f3'] ORDER BY name on node2 Executing query SELECT name FROM system.functions WHERE name IN ['f1', 'f2', 'f3'] ORDER BY name on node2 Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_4' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_4' on instance Executing query insert into test_s3_complex_types values(1,toDate('2020-10-01'), ['a','b'], [1,2], [3,4], [5,6]) on node1 Executing query insert into test_s3_complex_types values(1,toDate('2020-10-01'), ['a','b'], [1,2], [3,4], [5,6]) on node1 Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node [gw3] PASSED test_scheduler/test.py::test_resource_any_disk test_scheduler/test.py::test_resource_read_and_write Executing query select * from `postgres_database`.`postgresql_replica_4` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_4` order by key; on instance http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] Executing query select 20 on node Executing query select 20 on node Executing query insert into test_s3_complex_types values(1,toDate('2020-10-01'), ['a','b'], [7,8], [9,10], [11,12]) on node1 Executing query insert into test_s3_complex_types values(1,toDate('2020-10-01'), ['a','b'], [7,8], [9,10], [11,12]) on node1 Executing query select * from `test_database`.`postgresql_replica_4` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_4` order by key; on instance Executing query SELECT name FROM system.functions WHERE name IN ['f1', 'f2', 'f3'] ORDER BY name on node2 Executing query SELECT name FROM system.functions WHERE name IN ['f1', 'f2', 'f3'] ORDER BY name on node2 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['zookeeper', 'clickhouse'] Received response(xid=1): ['zookeeper', 'clickhouse'] Sending request(xid=2): Close() Sending request(xid=2): Close() Closing connection to 172.16.4.3:2281 Closing connection to 172.16.4.3:2281 Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo3 get_instance_ip instance_name=zoo3 http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw8-zoo3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw8-zoo3-1/json HTTP/1.1" 200 None get_kazoo_client: zoo3, ip:172.16.4.4, port:2281, use_ssl:True get_kazoo_client: zoo3, ip:172.16.4.4, port:2281, use_ssl:True Connecting to 172.16.4.4(172.16.4.4):2281, use_ssl: True Connecting to 172.16.4.4(172.16.4.4):2281, use_ssl: True [gw1] PASSED test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Executing query system reload config on node Executing query system reload config on node http://172.16.7.8:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 http://172.16.7.8:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 Executing query optimize table test_s3_complex_types final on node1 Executing query optimize table test_s3_complex_types final on node1 Executing query select 20 on node Executing query select 20 on node Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Executing query SELECT name FROM system.functions WHERE name IN ['f1', 'f2', 'f3'] ORDER BY name on node2 Executing query SELECT name FROM system.functions WHERE name IN ['f1', 'f2', 'f3'] ORDER BY name on node2 Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query drop table if exists data; create table data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3_no_resource'; on node Executing query drop table if exists data; create table data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3_no_resource'; on node http://172.16.7.8:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 http://172.16.7.8:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 Executing query DROP TABLE test_s3_complex_types SYNC on node1 Executing query DROP TABLE test_s3_complex_types SYNC on node1 Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query select 20 on node Executing query select 20 on node Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['zookeeper', 'clickhouse'] Received response(xid=1): ['zookeeper', 'clickhouse'] Sending request(xid=2): Close() Sending request(xid=2): Close() Closing connection to 172.16.4.4:2281 Closing connection to 172.16.4.4:2281 Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED All instances of ZooKeeper started: ['zoo1', 'zoo2', 'zoo3'] All instances of ZooKeeper started: ['zoo1', 'zoo2', 'zoo3'] Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query create resource io_write (write disk s3_no_resource); create resource io_read (read disk s3_no_resource); create workload all settings max_cost = 1000000; create workload admin in all settings priority = 0; create workload production in all settings priority = 1, weight = 9; create workload development in all settings priority = 1, weight = 1; on node Executing query create resource io_write (write disk s3_no_resource); create resource io_read (read disk s3_no_resource); create workload all settings max_cost = 1000000; create workload admin in all settings priority = 0; create workload production in all settings priority = 1, weight = 9; create workload development in all settings priority = 1, weight = 1; on node Executing query SELECT name FROM system.functions WHERE name IN ['f1', 'f2', 'f3'] ORDER BY name on node2 Executing query SELECT name FROM system.functions WHERE name IN ['f1', 'f2', 'f3'] ORDER BY name on node2 [gw6] PASSED test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy_no_proxy http://172.16.7.8:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 http://172.16.7.8:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 Executing query DROP TABLE warming_up SYNC on node1 Executing query DROP TABLE warming_up SYNC on node1 Executing query INSERT INTO FUNCTION s3('http://minio1:9001/root/data/remote_proxy_node_no_proxy/test.csv', 'minio', 'minio123', 'CSV', 'key String, value String') VALUES ('color','red'),('size','10') on remote_proxy_node_no_proxy Executing query INSERT INTO FUNCTION s3('http://minio1:9001/root/data/remote_proxy_node_no_proxy/test.csv', 'minio', 'minio123', 'CSV', 'key String, value String') VALUES ('color','red'),('size','10') on remote_proxy_node_no_proxy test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries Executing query INSERT INTO `postgres_database`.test_many_conc_0 SELECT number, number from numbers(10000) on instance Executing query INSERT INTO `postgres_database`.test_many_conc_0 SELECT number, number from numbers(10000) on instance Executing query insert into data select * from numbers(1e5) settings workload='development' on node Executing query insert into data select * from numbers(1e5) settings workload='development' on node Executing query insert into data select * from numbers(1e5) settings workload='production' on node Executing query insert into data select * from numbers(1e5) settings workload='production' on node Executing query insert into data select * from numbers(1e5) settings workload='admin' on node Executing query insert into data select * from numbers(1e5) settings workload='admin' on node Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/.env --project-name roottestreplicateds3zerocopydroppartition-gw9 --file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/.env --project-name roottestreplicateds3zerocopydroppartition-gw9 --file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml stop --timeout 20] [gw9] PASSED test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query SELECT * FROM s3('http://minio1:9001/root/data/remote_proxy_node_no_proxy/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on remote_proxy_node_no_proxy Executing query SELECT * FROM s3('http://minio1:9001/root/data/remote_proxy_node_no_proxy/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on remote_proxy_node_no_proxy Executing query select 20 on node Executing query select 20 on node Executing query INSERT INTO `postgres_database`.test_many_conc_1 SELECT number, number from numbers(10000) on instance Executing query INSERT INTO `postgres_database`.test_many_conc_1 SELECT number, number from numbers(10000) on instance Executing query SELECT name FROM system.functions WHERE name IN ['f1', 'f2', 'f3'] ORDER BY name on node2 Executing query SELECT name FROM system.functions WHERE name IN ['f1', 'f2', 'f3'] ORDER BY name on node2 Executing query SELECT * FROM s3('http://minio1:9001/root/data/remote_proxy_node_no_proxy/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on remote_proxy_node_no_proxy Executing query SELECT * FROM s3('http://minio1:9001/root/data/remote_proxy_node_no_proxy/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on remote_proxy_node_no_proxy Executing query select dequeued_requests>0 from system.scheduler where resource='io_write' and path ilike '%/admin/%' and type='fifo' on node Executing query select dequeued_requests>0 from system.scheduler where resource='io_write' and path ilike '%/admin/%' and type='fifo' on node [gw4] PASSED test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/max_bytes_for_level_base/no_such_table_column_family_option/g' /etc/clickhouse-server/config.d/rocksdb.xml"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/max_bytes_for_level_base/no_such_table_column_family_option/g' /etc/clickhouse-server/config.d/rocksdb.xml"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c sed -i 's/max_bytes_for_level_base/no_such_table_column_family_option/g' /etc/clickhouse-server/config.d/rocksdb.xml] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c sed -i 's/max_bytes_for_level_base/no_such_table_column_family_option/g' /etc/clickhouse-server/config.d/rocksdb.xml] Executing query INSERT INTO `postgres_database`.test_many_conc_2 SELECT number, number from numbers(10000) on instance Executing query INSERT INTO `postgres_database`.test_many_conc_2 SELECT number, number from numbers(10000) on instance run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c ps -C clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c ps -C clickhouse] Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Stdout: PID TTY TIME CMD Stdout: PID TTY TIME CMD Stdout: 6251 ? 00:00:03 clickhouse Stdout: 6251 ? 00:00:03 clickhouse run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c pkill clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c pkill clickhouse] http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None Executing query select dequeued_requests>0 from system.scheduler where resource='io_write' and path ilike '%/development/%' and type='fifo' on node Executing query select dequeued_requests>0 from system.scheduler where resource='io_write' and path ilike '%/development/%' and type='fifo' on node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None Stdout:6251 Stdout:6251 Executing query SELECT name FROM system.functions WHERE name IN ['f1', 'f2', 'f3'] ORDER BY name on node2 Executing query SELECT name FROM system.functions WHERE name IN ['f1', 'f2', 'f3'] ORDER BY name on node2 Executing query INSERT INTO `postgres_database`.test_many_conc_3 SELECT number, number from numbers(10000) on instance Executing query INSERT INTO `postgres_database`.test_many_conc_3 SELECT number, number from numbers(10000) on instance Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query select dequeued_requests>0 from system.scheduler where resource='io_write' and path ilike '%/production/%' and type='fifo' on node Executing query select dequeued_requests>0 from system.scheduler where resource='io_write' and path ilike '%/production/%' and type='fifo' on node Executing query SELECT f1(12, 3), f2(), f3(12, 3) on node2 Executing query SELECT f1(12, 3), f2(), f3(12, 3) on node2 Executing query INSERT INTO `postgres_database`.test_many_conc_4 SELECT number, number from numbers(10000) on instance Executing query INSERT INTO `postgres_database`.test_many_conc_4 SELECT number, number from numbers(10000) on instance Executing query select sum(key*key) from data settings workload='development' on node Executing query select sum(key*key) from data settings workload='development' on node Executing query select sum(key*key) from data settings workload='production' on node Executing query select sum(key*key) from data settings workload='production' on node Executing query select sum(key*key) from data settings workload='admin' on node Executing query select sum(key*key) from data settings workload='admin' on node run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['ss', '--resolve', '--tcp', '--no-header', 'state', 'ESTABLISHED', '( dport = 2181 or sport = 2181 )'] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['ss', '--resolve', '--tcp', '--no-header', 'state', 'ESTABLISHED', '( dport = 2181 or sport = 2181 )'] Command:[docker exec -u root --privileged roottestreplicateduserdefinedfunctions-gw2-node1-1 ss --resolve --tcp --no-header state ESTABLISHED ( dport = 2181 or sport = 2181 )] Command:[docker exec -u root --privileged roottestreplicateduserdefinedfunctions-gw2-node1-1 ss --resolve --tcp --no-header state ESTABLISHED ( dport = 2181 or sport = 2181 )] Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:0 0 node1:55860 roottestreplicateduserdefinedfunctions-gw2-zoo2-1.roottestreplicateduserdefinedfunctions-gw2_default:2181 Stdout:0 0 node1:55860 roottestreplicateduserdefinedfunctions-gw2-zoo2-1.roottestreplicateduserdefinedfunctions-gw2_default:2181 Executing query DROP FUNCTION f1 on node1 Executing query DROP FUNCTION f1 on node1 Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query DROP DATABASE IF EXISTS `test_database` on instance Stdout:6251 Stdout:6251 Executing query DROP FUNCTION f2 on node1 Executing query DROP FUNCTION f2 on node1 Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query DROP FUNCTION f3 on node1 Executing query DROP FUNCTION f3 on node1 Executing query select dequeued_requests>0 from system.scheduler where resource='io_read' and path ilike '%/admin/%' and type='fifo' on node Executing query select dequeued_requests>0 from system.scheduler where resource='io_read' and path ilike '%/admin/%' and type='fifo' on node http://localhost:None "POST /v1.46/containers/dcbbb908b79f8e8f15fe94c778a087e5d97f5754f2e06fdf0feefad1176307e6/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/dcbbb908b79f8e8f15fe94c778a087e5d97f5754f2e06fdf0feefad1176307e6/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/2ba1da9a6f02ee14fa8f945996357df3c6ecac6623694bd034b3abd5a9b35575/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/2ba1da9a6f02ee14fa8f945996357df3c6ecac6623694bd034b3abd5a9b35575/start HTTP/1.1" 101 0 Executing query SHOW DATABASES on instance Executing query SHOW DATABASES on instance http://localhost:None "GET /v1.46/exec/2ba1da9a6f02ee14fa8f945996357df3c6ecac6623694bd034b3abd5a9b35575/json HTTP/1.1" 200 545 http://localhost:None "GET /v1.46/exec/2ba1da9a6f02ee14fa8f945996357df3c6ecac6623694bd034b3abd5a9b35575/json HTTP/1.1" 200 545 [network] dcbbb908b79f8e8f15fe94c778a087e5d97f5754f2e06fdf0feefad1176307e6: ['iptables', '--wait', '-D', 'DOCKER-USER', '-m', 'statistic', '--mode', 'random', '--probability', '0.01', '-p', 'tcp', '-s', '172.16.6.10', '--dport', '2181', '-j', 'REJECT', '--reject-with', 'tcp-reset'] (0): [network] dcbbb908b79f8e8f15fe94c778a087e5d97f5754f2e06fdf0feefad1176307e6: ['iptables', '--wait', '-D', 'DOCKER-USER', '-m', 'statistic', '--mode', 'random', '--probability', '0.01', '-p', 'tcp', '-s', '172.16.6.10', '--dport', '2181', '-j', 'REJECT', '--reject-with', 'tcp-reset'] (0): http://localhost:None "POST /v1.46/containers/dcbbb908b79f8e8f15fe94c778a087e5d97f5754f2e06fdf0feefad1176307e6/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/dcbbb908b79f8e8f15fe94c778a087e5d97f5754f2e06fdf0feefad1176307e6/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/f73611f124dedb598467e4746074a46dd96b298db04a094c818f1b809519f386/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/f73611f124dedb598467e4746074a46dd96b298db04a094c818f1b809519f386/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/exec/f73611f124dedb598467e4746074a46dd96b298db04a094c818f1b809519f386/json HTTP/1.1" 200 545 http://localhost:None "GET /v1.46/exec/f73611f124dedb598467e4746074a46dd96b298db04a094c818f1b809519f386/json HTTP/1.1" 200 545 [network] dcbbb908b79f8e8f15fe94c778a087e5d97f5754f2e06fdf0feefad1176307e6: ['iptables', '--wait', '-D', 'DOCKER-USER', '-m', 'statistic', '--mode', 'random', '--probability', '0.01', '-p', 'tcp', '-d', '172.16.6.10', '--sport', '2181', '-j', 'REJECT', '--reject-with', 'tcp-reset'] (0): [network] dcbbb908b79f8e8f15fe94c778a087e5d97f5754f2e06fdf0feefad1176307e6: ['iptables', '--wait', '-D', 'DOCKER-USER', '-m', 'statistic', '--mode', 'random', '--probability', '0.01', '-p', 'tcp', '-d', '172.16.6.10', '--sport', '2181', '-j', 'REJECT', '--reject-with', 'tcp-reset'] (0): run container_id:roottestreplicatedmergetrees3zerocopy-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'timeout 60 tail -Fn1000000 "/var/log/clickhouse-server/clickhouse-server.log" | grep -Em 1 \'Removing metadata metadata_dropped/default.test_drop_table\''] run container_id:roottestreplicatedmergetrees3zerocopy-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'timeout 60 tail -Fn1000000 "/var/log/clickhouse-server/clickhouse-server.log" | grep -Em 1 \'Removing metadata metadata_dropped/default.test_drop_table\''] Command:[docker exec roottestreplicatedmergetrees3zerocopy-gw5-node1-1 bash -c timeout 60 tail -Fn1000000 "/var/log/clickhouse-server/clickhouse-server.log" | grep -Em 1 'Removing metadata metadata_dropped/default.test_drop_table'] Command:[docker exec roottestreplicatedmergetrees3zerocopy-gw5-node1-1 bash -c timeout 60 tail -Fn1000000 "/var/log/clickhouse-server/clickhouse-server.log" | grep -Em 1 'Removing metadata metadata_dropped/default.test_drop_table'] Executing query select dequeued_requests>0 from system.scheduler where resource='io_read' and path ilike '%/development/%' and type='fifo' on node Executing query select dequeued_requests>0 from system.scheduler where resource='io_read' and path ilike '%/development/%' and type='fifo' on node Starting zookeeper node: zoo1 Starting zookeeper node: zoo1 Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml start zoo1] Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml start zoo1] http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:6251 Stdout:6251 Executing query select dequeued_requests>0 from system.scheduler where resource='io_read' and path ilike '%/production/%' and type='fifo' on node Executing query select dequeued_requests>0 from system.scheduler where resource='io_read' and path ilike '%/production/%' and type='fifo' on node Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Starting Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Starting Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Started Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Started Starting zookeeper node: zoo2 Starting zookeeper node: zoo2 Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml start zoo2] Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml start zoo2] Executing query INSERT INTO postgres_database.test_many_conc_0 SELECT 0*10000*(10000 + number), number from numbers(1000) on instance Executing query INSERT INTO postgres_database.test_many_conc_0 SELECT 0*10000*(10000 + number), number from numbers(1000) on instance Executing query INSERT INTO postgres_database.test_many_conc_1 SELECT 1*10000*(10000 + number), number from numbers(1000) on instance Executing query INSERT INTO postgres_database.test_many_conc_1 SELECT 1*10000*(10000 + number), number from numbers(1000) on instance [gw3] PASSED test_scheduler/test.py::test_resource_read_and_write Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node test_scheduler/test.py::test_s3_disk Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node Starting zookeeper node: zoo3 Starting zookeeper node: zoo3 Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml start zoo3] Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml start zoo3] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo \'\n \n \n zoo1\n 2181\n \n \n zoo2\n 2181\n \n \n zoo3\n 2181\n \n 20000\n \n\n\' > /etc/clickhouse-server/conf.d/zookeeper.xml'] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo \'\n \n \n zoo1\n 2181\n \n \n zoo2\n 2181\n \n \n zoo3\n 2181\n \n 20000\n \n\n\' > /etc/clickhouse-server/conf.d/zookeeper.xml'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c echo ' zoo1 2181 zoo2 2181 zoo3 2181 20000 ' > /etc/clickhouse-server/conf.d/zookeeper.xml] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c echo ' zoo1 2181 zoo2 2181 zoo3 2181 20000 ' > /etc/clickhouse-server/conf.d/zookeeper.xml] http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None Executing query INSERT INTO postgres_database.test_many_conc_1 SELECT 1*10000*(10001 + number), number from numbers(1000) on instance Executing query INSERT INTO postgres_database.test_many_conc_1 SELECT 1*10000*(10001 + number), number from numbers(1000) on instance http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None Executing query SYSTEM RELOAD CONFIG on node1 Executing query SYSTEM RELOAD CONFIG on node1 run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Executing query system reload config on node Executing query system reload config on node run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:6251 Stdout:6251 run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo \'\n \n \n zoo1\n 2181\n \n \n zoo2\n 2181\n \n \n zoo3\n 2181\n \n 20000\n \n\n\' > /etc/clickhouse-server/conf.d/zookeeper.xml'] run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo \'\n \n \n zoo1\n 2181\n \n \n zoo2\n 2181\n \n \n zoo3\n 2181\n \n 20000\n \n\n\' > /etc/clickhouse-server/conf.d/zookeeper.xml'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c echo ' zoo1 2181 zoo2 2181 zoo3 2181 20000 ' > /etc/clickhouse-server/conf.d/zookeeper.xml] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c echo ' zoo1 2181 zoo2 2181 zoo3 2181 20000 ' > /etc/clickhouse-server/conf.d/zookeeper.xml] Executing query drop table if exists data; create table data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3'; on node Executing query drop table if exists data; create table data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3'; on node Executing query SYSTEM RELOAD CONFIG on node2 Executing query SYSTEM RELOAD CONFIG on node2 Executing query INSERT INTO postgres_database.test_many_conc_2 SELECT 2*10000*(10000 + number), number from numbers(1000) on instance Executing query INSERT INTO postgres_database.test_many_conc_2 SELECT 2*10000*(10000 + number), number from numbers(1000) on instance Executing query insert into data select * from numbers(1e5) settings workload='development' on node Executing query insert into data select * from numbers(1e5) settings workload='development' on node Executing query insert into data select * from numbers(1e5) settings workload='production' on node Executing query insert into data select * from numbers(1e5) settings workload='production' on node Executing query insert into data select * from numbers(1e5) settings workload='admin' on node Executing query insert into data select * from numbers(1e5) settings workload='admin' on node Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,num2) SELECT number + 0 AS num, number + 1 + 0 AS num2 FROM numbers_mt(1000) on node1 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,num2) SELECT number + 0 AS num, number + 1 + 0 AS num2 FROM numbers_mt(1000) on node1 [gw2] PASSED test_replicated_user_defined_functions/test.py::test_reload_zookeeper test_replicated_user_defined_functions/test.py::test_replication Executing query CREATE FUNCTION f2 AS (x, y) -> x - y on node1 Executing query CREATE FUNCTION f2 AS (x, y) -> x - y on node1 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None Executing query INSERT INTO postgres_database.test_many_conc_2 SELECT 2*10000*(10001 + number), number from numbers(1000) on instance Executing query INSERT INTO postgres_database.test_many_conc_2 SELECT 2*10000*(10001 + number), number from numbers(1000) on instance Executing query CREATE FUNCTION f3 AS () -> (SELECT sum(s) FROM (SELECT 1 as s UNION ALL SELECT 1 as s)) on node1 Executing query CREATE FUNCTION f3 AS () -> (SELECT sum(s) FROM (SELECT 1 as s UNION ALL SELECT 1 as s)) on node1 run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query INSERT INTO postgres_database.test_many_conc_3 SELECT 3*10000*(10000 + number), number from numbers(1000) on instance Executing query INSERT INTO postgres_database.test_many_conc_3 SELECT 3*10000*(10000 + number), number from numbers(1000) on instance Stdout:2025.04.02 02:53:59.502381 [ 763 ] {} DatabaseCatalog: Removing metadata metadata_dropped/default.test_drop_table.f4790525-1bb2-4027-b078-508e9b636318.sql of dropped table default.test_drop_table (f4790525-1bb2-4027-b078-508e9b636318) Stdout:2025.04.02 02:53:59.502381 [ 763 ] {} DatabaseCatalog: Removing metadata metadata_dropped/default.test_drop_table.f4790525-1bb2-4027-b078-508e9b636318.sql of dropped table default.test_drop_table (f4790525-1bb2-4027-b078-508e9b636318) 1 log line(s) matching "Removing metadata metadata_dropped/default.test_drop_table" appeared in a 2.721 seconds 1 log line(s) matching "Removing metadata metadata_dropped/default.test_drop_table" appeared in a 2.721 seconds Executing query select name from system.zookeeper where path='/test/drop_table/replicas' on node1 Executing query select name from system.zookeeper where path='/test/drop_table/replicas' on node1 Stdout:6251 Stdout:6251 Executing query select dequeued_requests>0 from system.scheduler where resource='network_write' and path='/prio/admin' on node Executing query select dequeued_requests>0 from system.scheduler where resource='network_write' and path='/prio/admin' on node Executing query SELECT create_query FROM system.functions WHERE name='f2' on node1 Executing query SELECT create_query FROM system.functions WHERE name='f2' on node1 Executing query INSERT INTO postgres_database.test_many_conc_3 SELECT 3*10000*(10001 + number), number from numbers(1000) on instance Executing query INSERT INTO postgres_database.test_many_conc_3 SELECT 3*10000*(10001 + number), number from numbers(1000) on instance Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3' on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3' on node1 Executing query select dequeued_requests>0 from system.scheduler where resource='network_write' and path='/prio/fair/dev' on node Executing query select dequeued_requests>0 from system.scheduler where resource='network_write' and path='/prio/fair/dev' on node Executing query INSERT INTO postgres_database.test_many_conc_4 SELECT 4*10000*(10000 + number), number from numbers(1000) on instance Executing query INSERT INTO postgres_database.test_many_conc_4 SELECT 4*10000*(10000 + number), number from numbers(1000) on instance Executing query SELECT create_query FROM system.functions WHERE name='f2' on node2 Executing query SELECT create_query FROM system.functions WHERE name='f2' on node2 Executing query select dequeued_requests>0 from system.scheduler where resource='network_write' and path='/prio/fair/prod' on node Executing query select dequeued_requests>0 from system.scheduler where resource='network_write' and path='/prio/fair/prod' on node Executing query INSERT INTO postgres_database.test_many_conc_4 SELECT 4*10000*(10001 + number), number from numbers(1000) on instance Executing query INSERT INTO postgres_database.test_many_conc_4 SELECT 4*10000*(10001 + number), number from numbers(1000) on instance Executing query SELECT f2(12,3) on node1 Executing query SELECT f2(12,3) on node1 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None Executing query select sum(key*key) from data settings workload='development' on node Executing query select sum(key*key) from data settings workload='development' on node Executing query select sum(key*key) from data settings workload='production' on node Executing query select sum(key*key) from data settings workload='production' on node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None Executing query select sum(key*key) from data settings workload='admin' on node Executing query select sum(key*key) from data settings workload='admin' on node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None Executing query INSERT INTO postgres_database.test_many_conc_4 SELECT 4*10000*(10002 + number), number from numbers(1000) on instance Executing query INSERT INTO postgres_database.test_many_conc_4 SELECT 4*10000*(10002 + number), number from numbers(1000) on instance Executing query SELECT f2(12,3) on node2 Executing query SELECT f2(12,3) on node2 run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query SELECT f3() on node1 Executing query SELECT f3() on node1 run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] No clickhouse process running. Start new one. No clickhouse process running. Start new one. http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw4-node-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw4-node-1/exec HTTP/1.1" 201 74 Executing query select dequeued_requests>0 from system.scheduler where resource='network_read' and path='/prio/admin' on node Executing query select dequeued_requests>0 from system.scheduler where resource='network_read' and path='/prio/admin' on node http://localhost:None "POST /v1.46/exec/cf4fcf6406abf9cd69dc5c60f38bf6385b463d72487ea9ce0c17a269cf0d0fd1/start HTTP/1.1" 200 0 http://localhost:None "POST /v1.46/exec/cf4fcf6406abf9cd69dc5c60f38bf6385b463d72487ea9ce0c17a269cf0d0fd1/start HTTP/1.1" 200 0 http://localhost:None "GET /v1.46/exec/cf4fcf6406abf9cd69dc5c60f38bf6385b463d72487ea9ce0c17a269cf0d0fd1/json HTTP/1.1" 200 586 http://localhost:None "GET /v1.46/exec/cf4fcf6406abf9cd69dc5c60f38bf6385b463d72487ea9ce0c17a269cf0d0fd1/json HTTP/1.1" 200 586 Executing query SELECT f3() on node2 Executing query SELECT f3() on node2 Executing query detach table test_drop_table sync on node1 Executing query detach table test_drop_table sync on node1 Executing query DROP FUNCTION f2 on node1 Executing query DROP FUNCTION f2 on node1 Executing query select dequeued_requests>0 from system.scheduler where resource='network_read' and path='/prio/fair/dev' on node Executing query select dequeued_requests>0 from system.scheduler where resource='network_read' and path='/prio/fair/dev' on node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None Executing query DROP FUNCTION f3 on node1 Executing query DROP FUNCTION f3 on node1 Executing query select dequeued_requests>0 from system.scheduler where resource='network_read' and path='/prio/fair/prod' on node Executing query select dequeued_requests>0 from system.scheduler where resource='network_read' and path='/prio/fair/prod' on node Executing query SELECT create_query FROM system.functions WHERE name='f2' on node1 Executing query SELECT create_query FROM system.functions WHERE name='f2' on node1 Executing query attach table test_drop_table on node1 Executing query attach table test_drop_table on node1 run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node [gw3] PASSED test_scheduler/test.py::test_s3_disk test_scheduler/test.py::test_s3_resource_request_granularity Stdout:7060 Stdout:7060 Clickhouse process running. Clickhouse process running. run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:7060 Stdout:7060 Executing query select 20 on node Executing query select 20 on node Executing query SELECT create_query FROM system.functions WHERE name='f2' on node2 Executing query SELECT create_query FROM system.functions WHERE name='f2' on node2 run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] Executing query system sync replica test_drop_table on node1 Executing query system sync replica test_drop_table on node1 run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Executing query system reload config on node Executing query system reload config on node Executing query CREATE FUNCTION f2 AS (x, y) -> x - y on node1 Executing query CREATE FUNCTION f2 AS (x, y) -> x - y on node1 [gw2] PASSED test_replicated_user_defined_functions/test.py::test_replication test_replicated_user_defined_functions/test.py::test_replication_replace_by_another_node_after_creation Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE num2 % 1000 > 0 on node1 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE num2 % 1000 > 0 on node1 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None Executing query SELECT create_query FROM system.functions WHERE name='f2' on node2 Executing query SELECT create_query FROM system.functions WHERE name='f2' on node2 Executing query drop table if exists data; create table data (key UInt64 CODEC(NONE), value String CODEC(NONE)) engine=MergeTree() order by key settings min_bytes_for_wide_part=1e9, storage_policy='s3'; on node Executing query drop table if exists data; create table data (key UInt64 CODEC(NONE), value String CODEC(NONE)) engine=MergeTree() order by key settings min_bytes_for_wide_part=1e9, storage_policy='s3'; on node Executing query select 20 on node Executing query select 20 on node Executing query CREATE OR REPLACE FUNCTION f2 AS (x, y) -> x + y on node2 Executing query CREATE OR REPLACE FUNCTION f2 AS (x, y) -> x + y on node2 Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/admin' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/admin' on node Executing query SELECT create_query FROM system.functions WHERE name='f2' on node1 Executing query SELECT create_query FROM system.functions WHERE name='f2' on node1 Executing query select dequeued_cost from system.scheduler where resource='network_write' and path='/prio/admin' on node Executing query select dequeued_cost from system.scheduler where resource='network_write' and path='/prio/admin' on node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None Executing query DROP FUNCTION f2 on node1 Executing query DROP FUNCTION f2 on node1 Executing query select 20 on node Executing query select 20 on node Executing query select budget from system.scheduler where resource='network_write' and path='/prio/admin' on node Executing query select budget from system.scheduler where resource='network_write' and path='/prio/admin' on node Executing query SELECT create_query FROM system.functions WHERE name='f2' on node1 Executing query SELECT create_query FROM system.functions WHERE name='f2' on node1 Executing query insert into data select number, randomString(10000000) from numbers(5) SETTINGS workload='admin' on node Executing query insert into data select number, randomString(10000000) from numbers(5) SETTINGS workload='admin' on node Executing query SELECT create_query FROM system.functions WHERE name='f2' on node2 Executing query SELECT create_query FROM system.functions WHERE name='f2' on node2 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE num2 % 1000 > 0 on node2 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE num2 % 1000 > 0 on node2 Executing query drop table test_drop_table sync on node2 Executing query drop table test_drop_table sync on node2 Executing query select 20 on node Executing query select 20 on node [gw2] PASSED test_replicated_user_defined_functions/test.py::test_replication_replace_by_another_node_after_creation test_replicated_user_defined_functions/test.py::test_server_restart Executing query CREATE FUNCTION f1 AS () -> (SELECT sum(s) FROM (SELECT 1 as s UNION ALL SELECT 1 as s)) on node1 Executing query CREATE FUNCTION f1 AS () -> (SELECT sum(s) FROM (SELECT 1 as s UNION ALL SELECT 1 as s)) on node1 Executing query INSERT INTO postgres_database.test_many_conc_0 SELECT 50001 + number, number from numbers(5000) on instance Executing query INSERT INTO postgres_database.test_many_conc_0 SELECT 50001 + number, number from numbers(5000) on instance http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw6-proxy1-1/json HTTP/1.1" 200 None Executing query SELECT f1() on node1 Executing query SELECT f1() on node1 Executing query INSERT INTO postgres_database.test_many_conc_1 SELECT 50002 + number, number from numbers(5000) on instance Executing query INSERT INTO postgres_database.test_many_conc_1 SELECT 50002 + number, number from numbers(5000) on instance run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] Command:[docker exec -u root roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c ps -C clickhouse] Command:[docker exec -u root roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c ps -C clickhouse] Executing query select 20 on node Executing query select 20 on node Stdout: PID TTY TIME CMD Stdout: PID TTY TIME CMD Stdout: 8 ? 00:00:14 clickhouse Stdout: 8 ? 00:00:14 clickhouse run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] Command:[docker exec -u root roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c pkill clickhouse] Command:[docker exec -u root roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c pkill clickhouse] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query INSERT INTO postgres_database.test_many_conc_2 SELECT 50003 + number, number from numbers(5000) on instance Executing query INSERT INTO postgres_database.test_many_conc_2 SELECT 50003 + number, number from numbers(5000) on instance Stdout:8 Stdout:8 Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB PRIMARY KEY(key); on node Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB PRIMARY KEY(key); on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/admin' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/admin' on node Executing query INSERT INTO postgres_database.test_many_conc_3 SELECT 50004 + number, number from numbers(5000) on instance Executing query INSERT INTO postgres_database.test_many_conc_3 SELECT 50004 + number, number from numbers(5000) on instance [gw6] PASSED test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy_no_proxy Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/.env --project-name roottests3tablefunctionwithhttpproxy-gw6 --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node_no_proxy/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node_no_proxy/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node_no_proxy/docker-compose.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/.env --project-name roottests3tablefunctionwithhttpproxy-gw6 --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node_no_proxy/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node_no_proxy/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node_no_proxy/docker-compose.yml stop --timeout 20] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/no_such_table_column_family_option/max_bytes_for_level_base/g' /etc/clickhouse-server/config.d/rocksdb.xml"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/no_such_table_column_family_option/max_bytes_for_level_base/g' /etc/clickhouse-server/config.d/rocksdb.xml"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c sed -i 's/no_such_table_column_family_option/max_bytes_for_level_base/g' /etc/clickhouse-server/config.d/rocksdb.xml] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c sed -i 's/no_such_table_column_family_option/max_bytes_for_level_base/g' /etc/clickhouse-server/config.d/rocksdb.xml] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c ps -C clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c ps -C clickhouse] Stdout: PID TTY TIME CMD Stdout: PID TTY TIME CMD Stdout: 7060 ? 00:00:04 clickhouse Stdout: 7060 ? 00:00:04 clickhouse run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c pkill clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c pkill clickhouse] Executing query select dequeued_cost from system.scheduler where resource='network_write' and path='/prio/admin' on node Executing query select dequeued_cost from system.scheduler where resource='network_write' and path='/prio/admin' on node run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query INSERT INTO postgres_database.test_many_conc_4 SELECT 50005 + number, number from numbers(5000) on instance Executing query INSERT INTO postgres_database.test_many_conc_4 SELECT 50005 + number, number from numbers(5000) on instance Stdout:7060 Stdout:7060 Executing query select count(n), sum(n) from test_drop_table on node1 Executing query select count(n), sum(n) from test_drop_table on node1 Executing query select budget from system.scheduler where resource='network_write' and path='/prio/admin' on node Executing query select budget from system.scheduler where resource='network_write' and path='/prio/admin' on node Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE num2 % 1000 > 0 on node3 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE num2 % 1000 > 0 on node3 Executing query SELECT * FROM `test_database`.`test_many_conc_0` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`test_many_conc_0` LIMIT 1 FORMAT Null on instance run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query system flush logs on node Executing query system flush logs on node Stdout:8 Stdout:8 Executing query SHOW TABLES FROM `test_database` WHERE name = 'test_many_conc_0' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'test_many_conc_0' on instance Executing query select * from `postgres_database`.`test_many_conc_0` order by key; on instance Executing query select * from `postgres_database`.`test_many_conc_0` order by key; on instance run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query drop table test_drop_table sync on node1 Executing query drop table test_drop_table sync on node1 Stdout:7060 Stdout:7060 Executing query select * from `test_database`.`test_many_conc_0` order by key; on instance Executing query select * from `test_database`.`test_many_conc_0` order by key; on instance Executing query SELECT count() FROM postgres_database.test_many_conc_0 on instance Executing query SELECT count() FROM postgres_database.test_many_conc_0 on instance run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:8 Stdout:8 Executing query SELECT count() FROM (SELECT * FROM test_database.test_many_conc_0) on instance Executing query SELECT count() FROM (SELECT * FROM test_database.test_many_conc_0) on instance Executing query select ProfileEvents['SchedulerIOWriteRequests'] from system.query_log where query ilike '%workload=\'admin\'%' and type = 'QueryFinish' order by query_start_time_microseconds desc limit 1 on node Executing query select ProfileEvents['SchedulerIOWriteRequests'] from system.query_log where query ilike '%workload=\'admin\'%' and type = 'QueryFinish' order by query_start_time_microseconds desc limit 1 on node run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE num2 % 1000 > 0 on node4 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE num2 % 1000 > 0 on node4 Stdout:7060 Stdout:7060 Executing query SELECT * FROM `test_database`.`test_many_conc_1` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`test_many_conc_1` LIMIT 1 FORMAT Null on instance Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query system flush logs on node Executing query system flush logs on node Executing query SHOW TABLES FROM `test_database` WHERE name = 'test_many_conc_1' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'test_many_conc_1' on instance run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query DROP TABLE IF EXISTS test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster SYNC on node1 Executing query DROP TABLE IF EXISTS test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster SYNC on node1 Executing query select * from `postgres_database`.`test_many_conc_1` order by key; on instance Executing query select * from `postgres_database`.`test_many_conc_1` order by key; on instance Stdout:8 Stdout:8 Executing query select * from `test_database`.`test_many_conc_1` order by key; on instance Executing query select * from `test_database`.`test_many_conc_1` order by key; on instance Executing query DROP TABLE IF EXISTS test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster SYNC on node1 Executing query DROP TABLE IF EXISTS test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster SYNC on node1 Executing query select ProfileEvents['SchedulerIOWriteBytes'] from system.query_log where query ilike '%workload=\'admin\'%' and type = 'QueryFinish' order by query_start_time_microseconds desc limit 1 on node Executing query select ProfileEvents['SchedulerIOWriteBytes'] from system.query_log where query ilike '%workload=\'admin\'%' and type = 'QueryFinish' order by query_start_time_microseconds desc limit 1 on node Executing query SELECT count() FROM postgres_database.test_many_conc_1 on instance Executing query SELECT count() FROM postgres_database.test_many_conc_1 on instance run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] No clickhouse process running. Start new one. No clickhouse process running. Start new one. http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw4-node-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw4-node-1/exec HTTP/1.1" 201 74 Executing query optimize table data final on node Executing query optimize table data final on node Executing query SELECT count() FROM (SELECT * FROM test_database.test_many_conc_1) on instance Executing query SELECT count() FROM (SELECT * FROM test_database.test_many_conc_1) on instance http://localhost:None "POST /v1.46/exec/d44eaa88898f04ccf7b4c2b717bbdcdc81085f381bf9891024d02a5aec9de1f1/start HTTP/1.1" 200 0 http://localhost:None "POST /v1.46/exec/d44eaa88898f04ccf7b4c2b717bbdcdc81085f381bf9891024d02a5aec9de1f1/start HTTP/1.1" 200 0 http://localhost:None "GET /v1.46/exec/d44eaa88898f04ccf7b4c2b717bbdcdc81085f381bf9891024d02a5aec9de1f1/json HTTP/1.1" 200 586 http://localhost:None "GET /v1.46/exec/d44eaa88898f04ccf7b4c2b717bbdcdc81085f381bf9891024d02a5aec9de1f1/json HTTP/1.1" 200 586 run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query SELECT * FROM `test_database`.`test_many_conc_2` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`test_many_conc_2` LIMIT 1 FORMAT Null on instance Stdout:8 Stdout:8 Executing query SHOW TABLES FROM `test_database` WHERE name = 'test_many_conc_2' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'test_many_conc_2' on instance Executing query select * from `postgres_database`.`test_many_conc_2` order by key; on instance Executing query select * from `postgres_database`.`test_many_conc_2` order by key; on instance run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:7851 Stdout:7851 Clickhouse process running. Clickhouse process running. run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:7851 Stdout:7851 Executing query select 20 on node Executing query select 20 on node run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query select * from `test_database`.`test_many_conc_2` order by key; on instance Executing query select * from `test_database`.`test_many_conc_2` order by key; on instance [gw5] PASSED test_replicated_merge_tree_s3_zero_copy/test.py::test_drop_table Executing query DROP TABLE IF EXISTS s3_test SYNC on node1 Executing query DROP TABLE IF EXISTS s3_test SYNC on node1 Executing query SELECT count() FROM postgres_database.test_many_conc_2 on instance Executing query SELECT count() FROM postgres_database.test_many_conc_2 on instance Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node1 Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node1 Executing query SELECT count() FROM (SELECT * FROM test_database.test_many_conc_2) on instance Executing query SELECT count() FROM (SELECT * FROM test_database.test_many_conc_2) on instance Executing query DROP TABLE IF EXISTS s3_test SYNC on node2 Executing query DROP TABLE IF EXISTS s3_test SYNC on node2 Executing query select 20 on node Executing query select 20 on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/admin' on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/admin' on node Stdout:8 Stdout:8 Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node2 Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node2 Executing query SELECT * FROM `test_database`.`test_many_conc_3` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`test_many_conc_3` LIMIT 1 FORMAT Null on instance Executing query select dequeued_cost from system.scheduler where resource='network_read' and path='/prio/admin' on node Executing query select dequeued_cost from system.scheduler where resource='network_read' and path='/prio/admin' on node Executing query select 20 on node Executing query select 20 on node Executing query SHOW TABLES FROM `test_database` WHERE name = 'test_many_conc_3' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'test_many_conc_3' on instance Executing query DROP TABLE IF EXISTS s3_test SYNC on node3 Executing query DROP TABLE IF EXISTS s3_test SYNC on node3 Executing query select * from `postgres_database`.`test_many_conc_3` order by key; on instance Executing query select * from `postgres_database`.`test_many_conc_3` order by key; on instance Executing query select budget from system.scheduler where resource='network_read' and path='/prio/admin' on node Executing query select budget from system.scheduler where resource='network_read' and path='/prio/admin' on node run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node3 Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node3 No clickhouse process running. Start new one. No clickhouse process running. Start new one. Executing query select * from `test_database`.`test_many_conc_3` order by key; on instance Executing query select * from `test_database`.`test_many_conc_3` order by key; on instance Executing query select count() from data where not ignore(*) SETTINGS workload='admin' on node Executing query select count() from data where not ignore(*) SETTINGS workload='admin' on node http://localhost:None "POST /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-node1-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-node1-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/847ec1ddd5d64b1dc7fbc92e506c0300190319d2b104fccb00e11289d1043283/start HTTP/1.1" 200 0 http://localhost:None "POST /v1.46/exec/847ec1ddd5d64b1dc7fbc92e506c0300190319d2b104fccb00e11289d1043283/start HTTP/1.1" 200 0 http://localhost:None "GET /v1.46/exec/847ec1ddd5d64b1dc7fbc92e506c0300190319d2b104fccb00e11289d1043283/json HTTP/1.1" 200 586 http://localhost:None "GET /v1.46/exec/847ec1ddd5d64b1dc7fbc92e506c0300190319d2b104fccb00e11289d1043283/json HTTP/1.1" 200 586 [gw0] PASSED test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select test_rename_column/test.py::test_rename_parallel Executing query SELECT value FROM system.build_options WHERE name = 'CXX_FLAGS' on node1 Executing query SELECT value FROM system.build_options WHERE name = 'CXX_FLAGS' on node1 Resetting dropped connection: 172.16.6.7 Resetting dropped connection: 172.16.6.7 http://172.16.6.7:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 http://172.16.6.7:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[0-16] Executing query CREATE TABLE s3_test ON CLUSTER cluster ( dt Date, id Int64, data String, INDEX min_max (id) TYPE minmax GRANULARITY 3 ) ENGINE=ReplicatedMergeTree() PARTITION BY dt ORDER BY (dt, id) SETTINGS storage_policy='s3' ,min_rows_for_wide_part=0 on node1 Executing query CREATE TABLE s3_test ON CLUSTER cluster ( dt Date, id Int64, data String, INDEX min_max (id) TYPE minmax GRANULARITY 3 ) ENGINE=ReplicatedMergeTree() PARTITION BY dt ORDER BY (dt, id) SETTINGS storage_policy='s3' ,min_rows_for_wide_part=0 on node1 Executing query SELECT count() FROM postgres_database.test_many_conc_3 on instance Executing query SELECT count() FROM postgres_database.test_many_conc_3 on instance Executing query select 20 on node Executing query select 20 on node [gw0] SKIPPED test_rename_column/test.py::test_rename_parallel test_rename_column/test.py::test_rename_parallel_same_node Executing query SELECT value FROM system.build_options WHERE name = 'CXX_FLAGS' on node1 Executing query SELECT value FROM system.build_options WHERE name = 'CXX_FLAGS' on node1 Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/admin' on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/admin' on node Executing query SELECT count() FROM (SELECT * FROM test_database.test_many_conc_3) on instance Executing query SELECT count() FROM (SELECT * FROM test_database.test_many_conc_3) on instance [gw4] PASSED test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/max_open_files/no_such_table_option/g' /etc/clickhouse-server/config.d/rocksdb.xml"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/max_open_files/no_such_table_option/g' /etc/clickhouse-server/config.d/rocksdb.xml"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c sed -i 's/max_open_files/no_such_table_option/g' /etc/clickhouse-server/config.d/rocksdb.xml] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c sed -i 's/max_open_files/no_such_table_option/g' /etc/clickhouse-server/config.d/rocksdb.xml] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c ps -C clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c ps -C clickhouse] Stdout: PID TTY TIME CMD Stdout: PID TTY TIME CMD Stdout: 7851 ? 00:00:03 clickhouse Stdout: 7851 ? 00:00:03 clickhouse run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c pkill clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c pkill clickhouse] Executing query INSERT INTO s3_test VALUES ('2020-01-01',1,'RrccsDHDTa'),('2020-01-01',2,'pWTWOjXMub'),('2020-01-01',3,'UpVvhjHWfL'),('2020-01-01',4,'GsTUcPAGqC'),('2020-01-01',5,'GQtZtOWzWK'),('2020-01-01',6,'mjTsSgfwrN'),('2020-01-01',7,'yuZCUsyxGU'),('2020-01-01',8,'JMplniXpLp'),('2020-01-01',9,'VTcYRIjfBZ'),('2020-01-01',10,'lAJeOspwVp'),('2020-01-01',11,'juyUcNcKRM'),('2020-01-01',12,'NfzYdgCymy'),('2020-01-01',13,'ulEECnmSmJ'),('2020-01-01',14,'YQtKqERCeX'),('2020-01-01',15,'hjjZINiGBV'),('2020-01-01',16,'xpmAQSbHcP'),('2020-01-01',17,'XMzyrRDiMz'),('2020-01-01',18,'dRBgKhhUAe'),('2020-01-01',19,'zmBkqdtZDk'),('2020-01-01',20,'JvufSWYObl'),('2020-01-01',21,'ZnaZOWJyCL'),('2020-01-01',22,'bOxTZVezOL'),('2020-01-01',23,'xRAxmxDEpC'),('2020-01-01',24,'ydHJlzmEHZ'),('2020-01-01',25,'uqlMgnUJXG'),('2020-01-01',26,'UKAmtmRIID'),('2020-01-01',27,'DfUiAxUCKO'),('2020-01-01',28,'PKfMQVpwvV'),('2020-01-01',29,'RjPTMYeera'),('2020-01-01',30,'YssBpxlrDU'),('2020-01-01',31,'RcrSokccJR'),('2020-01-01',32,'aaF on node1 Executing query INSERT INTO s3_test VALUES ('2020-01-01',1,'RrccsDHDTa'),('2020-01-01',2,'pWTWOjXMub'),('2020-01-01',3,'UpVvhjHWfL'),('2020-01-01',4,'GsTUcPAGqC'),('2020-01-01',5,'GQtZtOWzWK'),('2020-01-01',6,'mjTsSgfwrN'),('2020-01-01',7,'yuZCUsyxGU'),('2020-01-01',8,'JMplniXpLp'),('2020-01-01',9,'VTcYRIjfBZ'),('2020-01-01',10,'lAJeOspwVp'),('2020-01-01',11,'juyUcNcKRM'),('2020-01-01',12,'NfzYdgCymy'),('2020-01-01',13,'ulEECnmSmJ'),('2020-01-01',14,'YQtKqERCeX'),('2020-01-01',15,'hjjZINiGBV'),('2020-01-01',16,'xpmAQSbHcP'),('2020-01-01',17,'XMzyrRDiMz'),('2020-01-01',18,'dRBgKhhUAe'),('2020-01-01',19,'zmBkqdtZDk'),('2020-01-01',20,'JvufSWYObl'),('2020-01-01',21,'ZnaZOWJyCL'),('2020-01-01',22,'bOxTZVezOL'),('2020-01-01',23,'xRAxmxDEpC'),('2020-01-01',24,'ydHJlzmEHZ'),('2020-01-01',25,'uqlMgnUJXG'),('2020-01-01',26,'UKAmtmRIID'),('2020-01-01',27,'DfUiAxUCKO'),('2020-01-01',28,'PKfMQVpwvV'),('2020-01-01',29,'RjPTMYeera'),('2020-01-01',30,'YssBpxlrDU'),('2020-01-01',31,'RcrSokccJR'),('2020-01-01',32,'aaF on node1 run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:7851 Stdout:7851 [gw0] SKIPPED test_rename_column/test.py::test_rename_parallel_same_node Executing query SELECT value FROM system.build_options WHERE name = 'CXX_FLAGS' on node1 Executing query SELECT value FROM system.build_options WHERE name = 'CXX_FLAGS' on node1 test_rename_column/test.py::test_rename_with_parallel_insert Executing query SELECT * FROM `test_database`.`test_many_conc_4` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`test_many_conc_4` LIMIT 1 FORMAT Null on instance Executing query select dequeued_cost from system.scheduler where resource='network_read' and path='/prio/admin' on node Executing query select dequeued_cost from system.scheduler where resource='network_read' and path='/prio/admin' on node [gw0] SKIPPED test_rename_column/test.py::test_rename_with_parallel_insert test_rename_column/test.py::test_rename_with_parallel_merges Executing query SELECT value FROM system.build_options WHERE name = 'CXX_FLAGS' on node1 Executing query SELECT value FROM system.build_options WHERE name = 'CXX_FLAGS' on node1 Executing query SHOW TABLES FROM `test_database` WHERE name = 'test_many_conc_4' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'test_many_conc_4' on instance run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query INSERT INTO s3_test VALUES ('2020-01-02',1,'ZKxwQrMWcy'),('2020-01-02',2,'tdFTukelvn'),('2020-01-02',3,'GXgoQkpcnA'),('2020-01-02',4,'pnWfdeitSj'),('2020-01-02',5,'zjPBQRSXHt'),('2020-01-02',6,'txJqfzfcfI'),('2020-01-02',7,'bGZMfMQPnH'),('2020-01-02',8,'YridoGlmVN'),('2020-01-02',9,'KVQwdakFPh'),('2020-01-02',10,'TzjBtZeucg'),('2020-01-02',11,'dDyowPvcGS'),('2020-01-02',12,'ruvcbOliBh'),('2020-01-02',13,'UGLFkJyNsU'),('2020-01-02',14,'xCCLMXlDaY'),('2020-01-02',15,'bmuFvtRTWc'),('2020-01-02',16,'xcMZhxdkTu'),('2020-01-02',17,'GHhJvnpjWq'),('2020-01-02',18,'mOmlkncUsg'),('2020-01-02',19,'dAngDEBMVi'),('2020-01-02',20,'oehTcGCnNs'),('2020-01-02',21,'DJqCgXrYnH'),('2020-01-02',22,'IIBOcrcixH'),('2020-01-02',23,'jTEmhnnzSP'),('2020-01-02',24,'ChKCianrrP'),('2020-01-02',25,'oBkHsiVIfF'),('2020-01-02',26,'GxQfYTgcRo'),('2020-01-02',27,'diBlkJDVPH'),('2020-01-02',28,'mPoGJOMTgB'),('2020-01-02',29,'ECetdbEwzb'),('2020-01-02',30,'SqyylhTrzt'),('2020-01-02',31,'ExIDBEzCmD'),('2020-01-02',32,'jLf on node2 Executing query INSERT INTO s3_test VALUES ('2020-01-02',1,'ZKxwQrMWcy'),('2020-01-02',2,'tdFTukelvn'),('2020-01-02',3,'GXgoQkpcnA'),('2020-01-02',4,'pnWfdeitSj'),('2020-01-02',5,'zjPBQRSXHt'),('2020-01-02',6,'txJqfzfcfI'),('2020-01-02',7,'bGZMfMQPnH'),('2020-01-02',8,'YridoGlmVN'),('2020-01-02',9,'KVQwdakFPh'),('2020-01-02',10,'TzjBtZeucg'),('2020-01-02',11,'dDyowPvcGS'),('2020-01-02',12,'ruvcbOliBh'),('2020-01-02',13,'UGLFkJyNsU'),('2020-01-02',14,'xCCLMXlDaY'),('2020-01-02',15,'bmuFvtRTWc'),('2020-01-02',16,'xcMZhxdkTu'),('2020-01-02',17,'GHhJvnpjWq'),('2020-01-02',18,'mOmlkncUsg'),('2020-01-02',19,'dAngDEBMVi'),('2020-01-02',20,'oehTcGCnNs'),('2020-01-02',21,'DJqCgXrYnH'),('2020-01-02',22,'IIBOcrcixH'),('2020-01-02',23,'jTEmhnnzSP'),('2020-01-02',24,'ChKCianrrP'),('2020-01-02',25,'oBkHsiVIfF'),('2020-01-02',26,'GxQfYTgcRo'),('2020-01-02',27,'diBlkJDVPH'),('2020-01-02',28,'mPoGJOMTgB'),('2020-01-02',29,'ECetdbEwzb'),('2020-01-02',30,'SqyylhTrzt'),('2020-01-02',31,'ExIDBEzCmD'),('2020-01-02',32,'jLf on node2 Stdout:847 Stdout:847 Clickhouse process running. Clickhouse process running. run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:847 Stdout:847 Executing query select 20 on node1 Executing query select 20 on node1 [gw0] SKIPPED test_rename_column/test.py::test_rename_with_parallel_merges Executing query SELECT value FROM system.build_options WHERE name = 'CXX_FLAGS' on node1 Executing query SELECT value FROM system.build_options WHERE name = 'CXX_FLAGS' on node1 test_rename_column/test.py::test_rename_with_parallel_select Executing query select budget from system.scheduler where resource='network_read' and path='/prio/admin' on node Executing query select budget from system.scheduler where resource='network_read' and path='/prio/admin' on node Executing query select * from `postgres_database`.`test_many_conc_4` order by key; on instance Executing query select * from `postgres_database`.`test_many_conc_4` order by key; on instance Executing query SELECT value FROM system.build_options WHERE name = 'CXX_FLAGS' on node1 Executing query SELECT value FROM system.build_options WHERE name = 'CXX_FLAGS' on node1 [gw0] SKIPPED test_rename_column/test.py::test_rename_with_parallel_select test_rename_column/test.py::test_rename_with_parallel_slow_insert Executing query system flush logs on node Executing query system flush logs on node Executing query select * from `test_database`.`test_many_conc_4` order by key; on instance Executing query select * from `test_database`.`test_many_conc_4` order by key; on instance Executing query INSERT INTO s3_test VALUES ('2020-01-03',1,'AjUESuvZlb'),('2020-01-03',2,'CVLTTriaOv'),('2020-01-03',3,'GSnFdHKGpi'),('2020-01-03',4,'QQmFvYbyXp'),('2020-01-03',5,'BXduAGPwnh'),('2020-01-03',6,'JKvnVtQras'),('2020-01-03',7,'UbcgbUBpYj'),('2020-01-03',8,'mQXZsumxsw'),('2020-01-03',9,'dgtWSlSzDV'),('2020-01-03',10,'oZUADGjDKC'),('2020-01-03',11,'yMuVoRUfMg'),('2020-01-03',12,'HIDARooWeu'),('2020-01-03',13,'cjnuiZMCoD'),('2020-01-03',14,'tSgXTZEDUN'),('2020-01-03',15,'MFGxtSvVfc'),('2020-01-03',16,'MYElemuvst'),('2020-01-03',17,'nkWYrnNDVO'),('2020-01-03',18,'kyEsUIzSIM'),('2020-01-03',19,'LlBeuhYgkv'),('2020-01-03',20,'GfiBlrFlJR'),('2020-01-03',21,'ukvEVtGegX'),('2020-01-03',22,'LqECXFVegW'),('2020-01-03',23,'kzAynqDzUH'),('2020-01-03',24,'YZpgznxbtX'),('2020-01-03',25,'rNWRTaxvwk'),('2020-01-03',26,'MCjTDUpVid'),('2020-01-03',27,'NKJzENWxDS'),('2020-01-03',28,'XFthVgUhdr'),('2020-01-03',29,'mTukoFDnoS'),('2020-01-03',30,'inpUvSvNlX'),('2020-01-03',31,'XbQHYAzYjP'),('2020-01-03',32,'vPK on node3 Executing query INSERT INTO s3_test VALUES ('2020-01-03',1,'AjUESuvZlb'),('2020-01-03',2,'CVLTTriaOv'),('2020-01-03',3,'GSnFdHKGpi'),('2020-01-03',4,'QQmFvYbyXp'),('2020-01-03',5,'BXduAGPwnh'),('2020-01-03',6,'JKvnVtQras'),('2020-01-03',7,'UbcgbUBpYj'),('2020-01-03',8,'mQXZsumxsw'),('2020-01-03',9,'dgtWSlSzDV'),('2020-01-03',10,'oZUADGjDKC'),('2020-01-03',11,'yMuVoRUfMg'),('2020-01-03',12,'HIDARooWeu'),('2020-01-03',13,'cjnuiZMCoD'),('2020-01-03',14,'tSgXTZEDUN'),('2020-01-03',15,'MFGxtSvVfc'),('2020-01-03',16,'MYElemuvst'),('2020-01-03',17,'nkWYrnNDVO'),('2020-01-03',18,'kyEsUIzSIM'),('2020-01-03',19,'LlBeuhYgkv'),('2020-01-03',20,'GfiBlrFlJR'),('2020-01-03',21,'ukvEVtGegX'),('2020-01-03',22,'LqECXFVegW'),('2020-01-03',23,'kzAynqDzUH'),('2020-01-03',24,'YZpgznxbtX'),('2020-01-03',25,'rNWRTaxvwk'),('2020-01-03',26,'MCjTDUpVid'),('2020-01-03',27,'NKJzENWxDS'),('2020-01-03',28,'XFthVgUhdr'),('2020-01-03',29,'mTukoFDnoS'),('2020-01-03',30,'inpUvSvNlX'),('2020-01-03',31,'XbQHYAzYjP'),('2020-01-03',32,'vPK on node3 run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:7851 Stdout:7851 Executing query select 20 on node1 Executing query select 20 on node1 Executing query SELECT value FROM system.build_options WHERE name = 'CXX_FLAGS' on node1 [gw0] SKIPPED test_rename_column/test.py::test_rename_with_parallel_slow_insert test_rename_column/test.py::test_rename_with_parallel_ttl_delete Executing query SELECT value FROM system.build_options WHERE name = 'CXX_FLAGS' on node1 Executing query SELECT count() FROM postgres_database.test_many_conc_4 on instance Executing query SELECT count() FROM postgres_database.test_many_conc_4 on instance [gw0] SKIPPED test_rename_column/test.py::test_rename_with_parallel_ttl_delete Executing query SELECT value FROM system.build_options WHERE name = 'CXX_FLAGS' on node1 test_rename_column/test.py::test_rename_with_parallel_ttl_move Executing query SELECT value FROM system.build_options WHERE name = 'CXX_FLAGS' on node1 Executing query SELECT count() FROM (SELECT * FROM test_database.test_many_conc_4) on instance Executing query SELECT count() FROM (SELECT * FROM test_database.test_many_conc_4) on instance Executing query SELECT * FROM s3_test order by dt, id FORMAT Values on node1 Executing query SELECT * FROM s3_test order by dt, id FORMAT Values on node1 [gw0] SKIPPED test_rename_column/test.py::test_rename_with_parallel_ttl_move Command:[docker compose --env-file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/.env --project-name roottestrenamecolumn-gw0 --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node3/docker-compose.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node4/docker-compose.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/.env --project-name roottestrenamecolumn-gw0 --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node3/docker-compose.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node4/docker-compose.yml stop --timeout 20] Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-node1-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-node1-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-resolver-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-resolver-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-node1-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-node1-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-minio1-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-minio1-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo1-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo1-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo3-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo3-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo2-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo2-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-minio1-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-minio1-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo2-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo2-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo1-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo1-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo3-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo3-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-resolver-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-resolver-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-proxy2-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-proxy2-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-proxy1-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-proxy1-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-proxy1-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-proxy1-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-proxy2-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-proxy2-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/.env --project-name roottestreplicateds3zerocopydroppartition-gw9 --file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/.env --project-name roottestreplicateds3zerocopydroppartition-gw9 --file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml down --volumes] Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance [gw1] PASSED test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries Executing query select 20 on node1 Executing query select 20 on node1 Executing query SELECT * FROM s3_test order by dt, id FORMAT Values on node2 Executing query SELECT * FROM s3_test order by dt, id FORMAT Values on node2 Executing query select ProfileEvents['SchedulerIOReadRequests'] from system.query_log where query ilike '%workload=\'admin\'%' and type = 'QueryFinish' order by query_start_time_microseconds desc limit 1 on node Executing query select ProfileEvents['SchedulerIOReadRequests'] from system.query_log where query ilike '%workload=\'admin\'%' and type = 'QueryFinish' order by query_start_time_microseconds desc limit 1 on node Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query SELECT f1() on node1 Executing query SELECT f1() on node1 Stdout:7851 Stdout:7851 Executing query SELECT * FROM s3_test order by dt, id FORMAT Values on node3 Executing query SELECT * FROM s3_test order by dt, id FORMAT Values on node3 Executing query system flush logs on node Executing query system flush logs on node Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP FUNCTION f1 on node1 Executing query DROP FUNCTION f1 on node1 Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance http://172.16.6.7:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 http://172.16.6.7:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 [gw5] PASSED test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[0-16] Executing query DROP TABLE IF EXISTS s3_test SYNC on node1 Executing query DROP TABLE IF EXISTS s3_test SYNC on node1 [gw2] PASSED test_replicated_user_defined_functions/test.py::test_server_restart test_replicated_user_defined_functions/test.py::test_start_without_zookeeper run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] Command:[docker exec -u root roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps -C clickhouse] Command:[docker exec -u root roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps -C clickhouse] Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-resolver-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-resolver-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-node1-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-node1-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-resolver-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-resolver-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-resolver-1 Removing Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-resolver-1 Removing Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-node1-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-node1-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-node1-1 Removing Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-node1-1 Removing Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-resolver-1 Removed Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-resolver-1 Removed Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-node1-1 Removed Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-node1-1 Removed Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-minio1-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-minio1-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo1-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo1-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo2-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo2-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo3-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo3-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-minio1-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-minio1-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-minio1-1 Removing Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-minio1-1 Removing Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo1-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo1-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo1-1 Removing Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo1-1 Removing Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo2-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo2-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo2-1 Removing Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo2-1 Removing Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo3-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo3-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo3-1 Removing Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo3-1 Removing Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo3-1 Removed Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo3-1 Removed Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo1-1 Removed Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo1-1 Removed Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-minio1-1 Removed Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-minio1-1 Removed Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-proxy2-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-proxy2-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-proxy1-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-proxy1-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-proxy1-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-proxy1-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-proxy1-1 Removing Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-proxy1-1 Removing Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-proxy2-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-proxy2-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-proxy2-1 Removing Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-proxy2-1 Removing Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo2-1 Removed Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-zoo2-1 Removed Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-proxy2-1 Removed Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-proxy2-1 Removed Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-proxy1-1 Removed Stderr: Container roottestreplicateds3zerocopydroppartition-gw9-proxy1-1 Removed Stderr: Volume roottestreplicateds3zerocopydroppartition-gw9_data1-1 Removing Stderr: Volume roottestreplicateds3zerocopydroppartition-gw9_data1-1 Removing Stderr: Network roottestreplicateds3zerocopydroppartition-gw9_default Removing Stderr: Network roottestreplicateds3zerocopydroppartition-gw9_default Removing Stderr: Volume roottestreplicateds3zerocopydroppartition-gw9_data1-1 Removed Stderr: Volume roottestreplicateds3zerocopydroppartition-gw9_data1-1 Removed Stderr: Network roottestreplicateds3zerocopydroppartition-gw9_default Removed Stderr: Network roottestreplicateds3zerocopydroppartition-gw9_default Removed Cleanup called Cleanup called Docker networks for project roottestreplicateds3zerocopydroppartition-gw9 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicateds3zerocopydroppartition-gw9 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestreplicateds3zerocopydroppartition-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicateds3zerocopydroppartition-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Stdout: PID TTY TIME CMD Stdout: PID TTY TIME CMD Stdout: 8 ? 00:00:16 clickhouse Stdout: 8 ? 00:00:16 clickhouse run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] Command:[docker exec -u root roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c pkill clickhouse] Command:[docker exec -u root roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c pkill clickhouse] Docker volumes for project roottestreplicateds3zerocopydroppartition-gw9 are DRIVER VOLUME NAME Docker volumes for project roottestreplicateds3zerocopydroppartition-gw9 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestreplicateds3zerocopydroppartition-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestreplicateds3zerocopydroppartition-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestreplicateds3zerocopydroppartition-gw9 No running containers for project: roottestreplicateds3zerocopydroppartition-gw9 Trying to prune unused networks... Trying to prune unused networks... run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:11 Stdout:11 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:8 Stdout:8 Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 11 Volumes pruned: 11 test_postgresql_replica_database_engine_1/test.py::test_multiple_databases test_restore_external_engines/test.py::test_restore_table Running tests in /ClickHouse/tests/integration/test_restore_external_engines/test.py Running tests in /ClickHouse/tests/integration/test_restore_external_engines/test.py Cluster start called. is_up=False Cluster start called. is_up=False Docker networks for project roottestrestoreexternalengines-gw9 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestrestoreexternalengines-gw9 are NETWORK ID NAME DRIVER SCOPE Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node1 Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node1 Docker containers for project roottestrestoreexternalengines-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestrestoreexternalengines-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestrestoreexternalengines-gw9 are DRIVER VOLUME NAME Docker volumes for project roottestrestoreexternalengines-gw9 are DRIVER VOLUME NAME Cleanup called Cleanup called Executing query DROP DATABASE IF EXISTS "postgres_database_1" on instance Executing query DROP DATABASE IF EXISTS "postgres_database_1" on instance Docker networks for project roottestrestoreexternalengines-gw9 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestrestoreexternalengines-gw9 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestrestoreexternalengines-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestrestoreexternalengines-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestrestoreexternalengines-gw9 are DRIVER VOLUME NAME Docker volumes for project roottestrestoreexternalengines-gw9 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestrestoreexternalengines-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestrestoreexternalengines-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestrestoreexternalengines-gw9 No running containers for project: roottestrestoreexternalengines-gw9 Trying to prune unused networks... Trying to prune unused networks... Executing query select ProfileEvents['SchedulerIOReadBytes'] from system.query_log where query ilike '%workload=\'admin\'%' and type = 'QueryFinish' order by query_start_time_microseconds desc limit 1 on node Executing query select ProfileEvents['SchedulerIOReadBytes'] from system.query_log where query ilike '%workload=\'admin\'%' and type = 'QueryFinish' order by query_start_time_microseconds desc limit 1 on node Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:11 Stdout:11 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 11 Volumes pruned: 11 Setup directory for instance: replica1 Setup directory for instance: replica1 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_restore_external_engines/configs/remote_servers.xml', '/ClickHouse/tests/integration/test_restore_external_engines/configs/backups_disk.xml'] to /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica1/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_restore_external_engines/configs/remote_servers.xml', '/ClickHouse/tests/integration/test_restore_external_engines/configs/backups_disk.xml'] to /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica1/configs/config.d Setup database dir /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica1/database Setup database dir /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica1/database Setup logs dir /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica1/logs Setup logs dir /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica1/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] external_dir_abs_path=/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/backups external_dir_abs_path=/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/backups Setup directory for instance: replica2 Setup directory for instance: replica2 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_restore_external_engines/configs/remote_servers.xml', '/ClickHouse/tests/integration/test_restore_external_engines/configs/backups_disk.xml'] to /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica2/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_restore_external_engines/configs/remote_servers.xml', '/ClickHouse/tests/integration/test_restore_external_engines/configs/backups_disk.xml'] to /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica2/configs/config.d Setup database dir /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica2/database Setup database dir /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica2/database Setup logs dir /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica2/logs Setup logs dir /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica2/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] external_dir_abs_path=/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/backups external_dir_abs_path=/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/backups Setup directory for instance: replica3 Setup directory for instance: replica3 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_restore_external_engines/configs/remote_servers.xml', '/ClickHouse/tests/integration/test_restore_external_engines/configs/backups_disk.xml'] to /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica3/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_restore_external_engines/configs/remote_servers.xml', '/ClickHouse/tests/integration/test_restore_external_engines/configs/backups_disk.xml'] to /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica3/configs/config.d Setup database dir /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica3/database Setup database dir /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica3/database Setup logs dir /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica3/logs Setup logs dir /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica3/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] external_dir_abs_path=/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/backups external_dir_abs_path=/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/backups Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/keeper3/coordination', 'MYSQL8_HOST': 'mysql80', 'MYSQL8_PORT': '3306', 'MYSQL8_ROOT_HOST': '%', 'MYSQL8_LOGS': '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/mysql8/logs', 'MYSQL8_LOGS_FS': 'bind', 'MYSQL8_DOCKER_USER': '0'} stored in /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/keeper3/coordination', 'MYSQL8_HOST': 'mysql80', 'MYSQL8_PORT': '3306', 'MYSQL8_ROOT_HOST': '%', 'MYSQL8_LOGS': '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/mysql8/logs', 'MYSQL8_LOGS_FS': 'bind', 'MYSQL8_DOCKER_USER': '0'} stored in /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Executing query DROP TABLE IF EXISTS s3_test SYNC on node2 Executing query DROP TABLE IF EXISTS s3_test SYNC on node2 http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/.env --project-name roottestrestoreexternalengines-gw9 --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_mysql_8_0.yml --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica2/docker-compose.yml --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica3/docker-compose.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/.env --project-name roottestrestoreexternalengines-gw9 --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_mysql_8_0.yml --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica2/docker-compose.yml --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica3/docker-compose.yml pull] Executing query CREATE DATABASE "postgres_database_1" ENGINE = PostgreSQL('172.16.5.2:5432', 'postgres_database_1', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE "postgres_database_1" ENGINE = PostgreSQL('172.16.5.2:5432', 'postgres_database_1', 'postgres', 'mysecretpassword') on instance [gw3] PASSED test_scheduler/test.py::test_s3_resource_request_granularity test_scheduler/test.py::test_throw_on_unknown_workload Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query DROP DATABASE IF EXISTS "postgres_database_2" on instance Executing query DROP DATABASE IF EXISTS "postgres_database_2" on instance Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node2 Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node2 run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] No clickhouse process running. Start new one. No clickhouse process running. Start new one. http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw4-node-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw4-node-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/843fb8cf77476a94e47a4b1b508f220159fdc5cf6c3fac441ab2cb6df7ac2f6c/start HTTP/1.1" 200 0 http://localhost:None "POST /v1.46/exec/843fb8cf77476a94e47a4b1b508f220159fdc5cf6c3fac441ab2cb6df7ac2f6c/start HTTP/1.1" 200 0 http://localhost:None "GET /v1.46/exec/843fb8cf77476a94e47a4b1b508f220159fdc5cf6c3fac441ab2cb6df7ac2f6c/json HTTP/1.1" 200 586 http://localhost:None "GET /v1.46/exec/843fb8cf77476a94e47a4b1b508f220159fdc5cf6c3fac441ab2cb6df7ac2f6c/json HTTP/1.1" 200 586 Executing query CREATE DATABASE "postgres_database_2" ENGINE = PostgreSQL('172.16.5.2:5432', 'postgres_database_2', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE "postgres_database_2" ENGINE = PostgreSQL('172.16.5.2:5432', 'postgres_database_2', 'postgres', 'mysecretpassword') on instance Executing query DROP TABLE IF EXISTS s3_test SYNC on node3 Executing query DROP TABLE IF EXISTS s3_test SYNC on node3 run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Executing query system reload config on node Executing query system reload config on node Executing query INSERT INTO postgres_database_1.postgresql_replica_0 SELECT number, number from numbers(50) on instance Executing query INSERT INTO postgres_database_1.postgresql_replica_0 SELECT number, number from numbers(50) on instance run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:8 Stdout:8 Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node3 Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node3 Executing query INSERT INTO postgres_database_1.postgresql_replica_1 SELECT number, number from numbers(50) on instance Executing query INSERT INTO postgres_database_1.postgresql_replica_1 SELECT number, number from numbers(50) on instance Executing query drop table if exists data; create table data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3_no_resource'; on node Executing query drop table if exists data; create table data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3_no_resource'; on node http://172.16.6.7:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 http://172.16.6.7:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[8192-12] Executing query CREATE TABLE s3_test ON CLUSTER cluster ( dt Date, id Int64, data String, INDEX min_max (id) TYPE minmax GRANULARITY 3 ) ENGINE=ReplicatedMergeTree() PARTITION BY dt ORDER BY (dt, id) SETTINGS storage_policy='s3' ,min_rows_for_wide_part=8192 on node1 Executing query CREATE TABLE s3_test ON CLUSTER cluster ( dt Date, id Int64, data String, INDEX min_max (id) TYPE minmax GRANULARITY 3 ) ENGINE=ReplicatedMergeTree() PARTITION BY dt ORDER BY (dt, id) SETTINGS storage_policy='s3' ,min_rows_for_wide_part=8192 on node1 Executing query INSERT INTO postgres_database_1.postgresql_replica_2 SELECT number, number from numbers(50) on instance Executing query INSERT INTO postgres_database_1.postgresql_replica_2 SELECT number, number from numbers(50) on instance Executing query create resource io (write any disk, read any disk); create workload all settings max_cost = 1000000; on node Executing query create resource io (write any disk, read any disk); create workload all settings max_cost = 1000000; on node Executing query INSERT INTO postgres_database_1.postgresql_replica_3 SELECT number, number from numbers(50) on instance Executing query INSERT INTO postgres_database_1.postgresql_replica_3 SELECT number, number from numbers(50) on instance Executing query insert into data select * from numbers(1e5) on node Executing query insert into data select * from numbers(1e5) on node run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:8643 Stdout:8643 Clickhouse process running. Clickhouse process running. run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:8643 Stdout:8643 Executing query select 20 on node Executing query select 20 on node Executing query INSERT INTO postgres_database_1.postgresql_replica_4 SELECT number, number from numbers(50) on instance Executing query INSERT INTO postgres_database_1.postgresql_replica_4 SELECT number, number from numbers(50) on instance Executing query select dequeued_requests>0 from system.scheduler where resource='io' and path ilike '%/all/%' and type='fifo' on node Executing query select dequeued_requests>0 from system.scheduler where resource='io' and path ilike '%/all/%' and type='fifo' on node Executing query INSERT INTO s3_test VALUES ('2020-01-01',1,'LMioGnwKWw'),('2020-01-01',2,'uCocuSEwtx'),('2020-01-01',3,'TdlxrWsODY'),('2020-01-01',4,'badccVBLBW'),('2020-01-01',5,'hViRqLEsIs'),('2020-01-01',6,'DxytjIUOCi'),('2020-01-01',7,'XCYmtaifgY'),('2020-01-01',8,'nffRkAGMPP'),('2020-01-01',9,'hwTCVtdlyg'),('2020-01-01',10,'LwKoBCFivH'),('2020-01-01',11,'FJdkkpNxuL'),('2020-01-01',12,'bFMDDuPnVz'),('2020-01-01',13,'rCjQNcYQgY'),('2020-01-01',14,'MTgukDmcUB'),('2020-01-01',15,'kxdBbXwKcH'),('2020-01-01',16,'KgnXXTDXcO'),('2020-01-01',17,'oSchCgMzYa'),('2020-01-01',18,'RwRPxsSHds'),('2020-01-01',19,'DbTDVsORno'),('2020-01-01',20,'sgOoDlBtrL'),('2020-01-01',21,'IvJrkqMvgx'),('2020-01-01',22,'mwBcdBDplz'),('2020-01-01',23,'qzMgweANZh'),('2020-01-01',24,'vqUHelirZA'),('2020-01-01',25,'mFIgSxrCLB'),('2020-01-01',26,'vjwmmuqZSF'),('2020-01-01',27,'mbKpfUgfOl'),('2020-01-01',28,'IZkYICKdMc'),('2020-01-01',29,'AAOuqEhAZs'),('2020-01-01',30,'LAUTAkGWFD'),('2020-01-01',31,'BtdGYiiYOu'),('2020-01-01',32,'wfP on node1 Executing query INSERT INTO s3_test VALUES ('2020-01-01',1,'LMioGnwKWw'),('2020-01-01',2,'uCocuSEwtx'),('2020-01-01',3,'TdlxrWsODY'),('2020-01-01',4,'badccVBLBW'),('2020-01-01',5,'hViRqLEsIs'),('2020-01-01',6,'DxytjIUOCi'),('2020-01-01',7,'XCYmtaifgY'),('2020-01-01',8,'nffRkAGMPP'),('2020-01-01',9,'hwTCVtdlyg'),('2020-01-01',10,'LwKoBCFivH'),('2020-01-01',11,'FJdkkpNxuL'),('2020-01-01',12,'bFMDDuPnVz'),('2020-01-01',13,'rCjQNcYQgY'),('2020-01-01',14,'MTgukDmcUB'),('2020-01-01',15,'kxdBbXwKcH'),('2020-01-01',16,'KgnXXTDXcO'),('2020-01-01',17,'oSchCgMzYa'),('2020-01-01',18,'RwRPxsSHds'),('2020-01-01',19,'DbTDVsORno'),('2020-01-01',20,'sgOoDlBtrL'),('2020-01-01',21,'IvJrkqMvgx'),('2020-01-01',22,'mwBcdBDplz'),('2020-01-01',23,'qzMgweANZh'),('2020-01-01',24,'vqUHelirZA'),('2020-01-01',25,'mFIgSxrCLB'),('2020-01-01',26,'vjwmmuqZSF'),('2020-01-01',27,'mbKpfUgfOl'),('2020-01-01',28,'IZkYICKdMc'),('2020-01-01',29,'AAOuqEhAZs'),('2020-01-01',30,'LAUTAkGWFD'),('2020-01-01',31,'BtdGYiiYOu'),('2020-01-01',32,'wfP on node1 Executing query INSERT INTO postgres_database_2.postgresql_replica_0 SELECT number, number from numbers(50) on instance Executing query INSERT INTO postgres_database_2.postgresql_replica_0 SELECT number, number from numbers(50) on instance run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', "echo 'true' > /etc/clickhouse-server/config.d/workloads.xml"] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', "echo 'true' > /etc/clickhouse-server/config.d/workloads.xml"] Command:[docker exec roottestscheduler-gw3-node-1 bash -c echo 'true' > /etc/clickhouse-server/config.d/workloads.xml] Command:[docker exec roottestscheduler-gw3-node-1 bash -c echo 'true' > /etc/clickhouse-server/config.d/workloads.xml] Stdout:8 Stdout:8 Executing query system reload config on node Executing query system reload config on node Executing query INSERT INTO postgres_database_2.postgresql_replica_1 SELECT number, number from numbers(50) on instance Executing query INSERT INTO postgres_database_2.postgresql_replica_1 SELECT number, number from numbers(50) on instance Executing query INSERT INTO s3_test VALUES ('2020-01-02',1,'SScipSBcxN'),('2020-01-02',2,'MVEjXhFAng'),('2020-01-02',3,'aqAlTScduH'),('2020-01-02',4,'vwzUisAVLo'),('2020-01-02',5,'aZrUMSKGIq'),('2020-01-02',6,'rNSeLZxmuj'),('2020-01-02',7,'gLBYqoWlOz'),('2020-01-02',8,'iDSpoyIeCV'),('2020-01-02',9,'oPbtrLtCxk'),('2020-01-02',10,'yeBoBPVARR'),('2020-01-02',11,'mlOiufHJEO'),('2020-01-02',12,'gJbdEEPnzc'),('2020-01-02',13,'HGfKASOSfa'),('2020-01-02',14,'RJzscLsJtn'),('2020-01-02',15,'jeLlELgVqe'),('2020-01-02',16,'CHtgRblbzh'),('2020-01-02',17,'dOSuGwuwiw'),('2020-01-02',18,'jMkVyEsEwf'),('2020-01-02',19,'GOTaVzcgTD'),('2020-01-02',20,'UjubCMOVNT'),('2020-01-02',21,'ZsvanArLko'),('2020-01-02',22,'BJSoITHhtH'),('2020-01-02',23,'laoTKvOUqc'),('2020-01-02',24,'bDleNDynJk'),('2020-01-02',25,'IgSXuBDuiB'),('2020-01-02',26,'jfpIIYyflt'),('2020-01-02',27,'UJQwlPYeRB'),('2020-01-02',28,'leTDhIMkWW'),('2020-01-02',29,'XCMlkjNAKb'),('2020-01-02',30,'PluflfRyJA'),('2020-01-02',31,'IYxROXfZWv'),('2020-01-02',32,'FjD on node2 Executing query INSERT INTO s3_test VALUES ('2020-01-02',1,'SScipSBcxN'),('2020-01-02',2,'MVEjXhFAng'),('2020-01-02',3,'aqAlTScduH'),('2020-01-02',4,'vwzUisAVLo'),('2020-01-02',5,'aZrUMSKGIq'),('2020-01-02',6,'rNSeLZxmuj'),('2020-01-02',7,'gLBYqoWlOz'),('2020-01-02',8,'iDSpoyIeCV'),('2020-01-02',9,'oPbtrLtCxk'),('2020-01-02',10,'yeBoBPVARR'),('2020-01-02',11,'mlOiufHJEO'),('2020-01-02',12,'gJbdEEPnzc'),('2020-01-02',13,'HGfKASOSfa'),('2020-01-02',14,'RJzscLsJtn'),('2020-01-02',15,'jeLlELgVqe'),('2020-01-02',16,'CHtgRblbzh'),('2020-01-02',17,'dOSuGwuwiw'),('2020-01-02',18,'jMkVyEsEwf'),('2020-01-02',19,'GOTaVzcgTD'),('2020-01-02',20,'UjubCMOVNT'),('2020-01-02',21,'ZsvanArLko'),('2020-01-02',22,'BJSoITHhtH'),('2020-01-02',23,'laoTKvOUqc'),('2020-01-02',24,'bDleNDynJk'),('2020-01-02',25,'IgSXuBDuiB'),('2020-01-02',26,'jfpIIYyflt'),('2020-01-02',27,'UJQwlPYeRB'),('2020-01-02',28,'leTDhIMkWW'),('2020-01-02',29,'XCMlkjNAKb'),('2020-01-02',30,'PluflfRyJA'),('2020-01-02',31,'IYxROXfZWv'),('2020-01-02',32,'FjD on node2 Executing query select 20 on node Executing query select 20 on node Executing query insert into data select * from numbers(1e5) on node Executing query insert into data select * from numbers(1e5) on node Executing query INSERT INTO postgres_database_2.postgresql_replica_2 SELECT number, number from numbers(50) on instance Executing query INSERT INTO postgres_database_2.postgresql_replica_2 SELECT number, number from numbers(50) on instance Executing query INSERT INTO s3_test VALUES ('2020-01-03',1,'UzSZcNuuDR'),('2020-01-03',2,'VwRGaPhAog'),('2020-01-03',3,'HDVKbpFTwT'),('2020-01-03',4,'ADcpGToheb'),('2020-01-03',5,'QqsplrgdLV'),('2020-01-03',6,'RmotFyhSFZ'),('2020-01-03',7,'PUcZKknUxp'),('2020-01-03',8,'crmYvIgiNZ'),('2020-01-03',9,'AKQhzoTJiN'),('2020-01-03',10,'XNpVayNfoI'),('2020-01-03',11,'wFCNMEZNeQ'),('2020-01-03',12,'svSjgvXKOP'),('2020-01-03',13,'eKguYpLgTN'),('2020-01-03',14,'QMJlYvaDNe'),('2020-01-03',15,'VwOsTWUXep'),('2020-01-03',16,'XPfooYgbXW'),('2020-01-03',17,'aqBwWzfsge'),('2020-01-03',18,'GFEKYmWgEZ'),('2020-01-03',19,'XIWFkeWdBm'),('2020-01-03',20,'hBYiHasZhs'),('2020-01-03',21,'PuOEnhhVaf'),('2020-01-03',22,'opQXDezNhI'),('2020-01-03',23,'cZIxFbhCyo'),('2020-01-03',24,'mzrWyMfzlC'),('2020-01-03',25,'HeoWnEDisf'),('2020-01-03',26,'TkQCmbOLjs'),('2020-01-03',27,'cClohaOtvN'),('2020-01-03',28,'USOBxXjUEi'),('2020-01-03',29,'cwMsfkpelo'),('2020-01-03',30,'eJbXtdnRTC'),('2020-01-03',31,'QWIECfTJei'),('2020-01-03',32,'GLz on node3 Executing query INSERT INTO s3_test VALUES ('2020-01-03',1,'UzSZcNuuDR'),('2020-01-03',2,'VwRGaPhAog'),('2020-01-03',3,'HDVKbpFTwT'),('2020-01-03',4,'ADcpGToheb'),('2020-01-03',5,'QqsplrgdLV'),('2020-01-03',6,'RmotFyhSFZ'),('2020-01-03',7,'PUcZKknUxp'),('2020-01-03',8,'crmYvIgiNZ'),('2020-01-03',9,'AKQhzoTJiN'),('2020-01-03',10,'XNpVayNfoI'),('2020-01-03',11,'wFCNMEZNeQ'),('2020-01-03',12,'svSjgvXKOP'),('2020-01-03',13,'eKguYpLgTN'),('2020-01-03',14,'QMJlYvaDNe'),('2020-01-03',15,'VwOsTWUXep'),('2020-01-03',16,'XPfooYgbXW'),('2020-01-03',17,'aqBwWzfsge'),('2020-01-03',18,'GFEKYmWgEZ'),('2020-01-03',19,'XIWFkeWdBm'),('2020-01-03',20,'hBYiHasZhs'),('2020-01-03',21,'PuOEnhhVaf'),('2020-01-03',22,'opQXDezNhI'),('2020-01-03',23,'cZIxFbhCyo'),('2020-01-03',24,'mzrWyMfzlC'),('2020-01-03',25,'HeoWnEDisf'),('2020-01-03',26,'TkQCmbOLjs'),('2020-01-03',27,'cClohaOtvN'),('2020-01-03',28,'USOBxXjUEi'),('2020-01-03',29,'cwMsfkpelo'),('2020-01-03',30,'eJbXtdnRTC'),('2020-01-03',31,'QWIECfTJei'),('2020-01-03',32,'GLz on node3 [gw3] PASSED test_scheduler/test.py::test_throw_on_unknown_workload Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node test_scheduler/test.py::test_workload_entity_keeper_storage Executing query INSERT INTO postgres_database_2.postgresql_replica_3 SELECT number, number from numbers(50) on instance Executing query INSERT INTO postgres_database_2.postgresql_replica_3 SELECT number, number from numbers(50) on instance run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] Executing query INSERT INTO postgres_database_2.postgresql_replica_4 SELECT number, number from numbers(50) on instance Executing query INSERT INTO postgres_database_2.postgresql_replica_4 SELECT number, number from numbers(50) on instance run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Executing query system reload config on node Executing query system reload config on node Executing query SELECT * FROM s3_test order by dt, id FORMAT Values on node1 Executing query SELECT * FROM s3_test order by dt, id FORMAT Values on node1 Executing query select 20 on node Executing query select 20 on node run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query SELECT name FROM system.tables WHERE database = 'postgres_database_1'; on instance Executing query SELECT name FROM system.tables WHERE database = 'postgres_database_1'; on instance Stdout:8 Stdout:8 Executing query SELECT * FROM s3_test order by dt, id FORMAT Values on node2 Executing query SELECT * FROM s3_test order by dt, id FORMAT Values on node2 Executing query create resource io_write (write disk s3_no_resource); on node Executing query create resource io_write (write disk s3_no_resource); on node Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB PRIMARY KEY(key); on node Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB PRIMARY KEY(key); on node Executing query SELECT name FROM system.tables WHERE database = 'postgres_database_2'; on instance Executing query SELECT name FROM system.tables WHERE database = 'postgres_database_2'; on instance Executing query create resource io_read (read disk s3_no_resource); on node Executing query create resource io_read (read disk s3_no_resource); on node Executing query DROP DATABASE IF EXISTS `test_database_1` on instance Executing query DROP DATABASE IF EXISTS `test_database_1` on instance Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Executing query CREATE DATABASE `test_database_1` ENGINE = MaterializedPostgreSQL('172.16.5.2:5432', 'postgres_database_1', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE `test_database_1` ENGINE = MaterializedPostgreSQL('172.16.5.2:5432', 'postgres_database_1', 'postgres', 'mysecretpassword') on instance Executing query SELECT * FROM s3_test order by dt, id FORMAT Values on node3 Executing query SELECT * FROM s3_test order by dt, id FORMAT Values on node3 run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/no_such_table_option/max_open_files/g' /etc/clickhouse-server/config.d/rocksdb.xml"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/no_such_table_option/max_open_files/g' /etc/clickhouse-server/config.d/rocksdb.xml"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c sed -i 's/no_such_table_option/max_open_files/g' /etc/clickhouse-server/config.d/rocksdb.xml] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c sed -i 's/no_such_table_option/max_open_files/g' /etc/clickhouse-server/config.d/rocksdb.xml] http://localhost:None "POST /v1.46/containers/create HTTP/1.1" 201 88 http://localhost:None "POST /v1.46/containers/create HTTP/1.1" 201 88 http://localhost:None "GET /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/json HTTP/1.1" 200 None run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c ps -C clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c ps -C clickhouse] Stdout: PID TTY TIME CMD Stdout: PID TTY TIME CMD Stdout: 8643 ? 00:00:05 clickhouse Stdout: 8643 ? 00:00:05 clickhouse run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c pkill clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw4-node-1 bash -c pkill clickhouse] run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query SHOW DATABASES on instance Executing query SHOW DATABASES on instance run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/start HTTP/1.1" 204 0 http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/start HTTP/1.1" 204 0 [network] Created new container a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc [network] Created new container a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/1e3b2c278d16a39b590c74e72ec8d632f6577237a51ee4f12ad5a9e44b37e426/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/1e3b2c278d16a39b590c74e72ec8d632f6577237a51ee4f12ad5a9e44b37e426/start HTTP/1.1" 101 0 Stdout:8643 Stdout:8643 Stdout:8 Stdout:8 Stdout:769 Stdout:769 http://172.16.6.7:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 http://172.16.6.7:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 [gw5] PASSED test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[8192-12] Executing query DROP TABLE IF EXISTS s3_test SYNC on node1 Executing query DROP TABLE IF EXISTS s3_test SYNC on node1 http://localhost:None "GET /v1.46/exec/1e3b2c278d16a39b590c74e72ec8d632f6577237a51ee4f12ad5a9e44b37e426/json HTTP/1.1" 200 460 http://localhost:None "GET /v1.46/exec/1e3b2c278d16a39b590c74e72ec8d632f6577237a51ee4f12ad5a9e44b37e426/json HTTP/1.1" 200 460 [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-s', '172.16.8.9', '--dport', '2181', '-j', 'DROP'] (0): [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-s', '172.16.8.9', '--dport', '2181', '-j', 'DROP'] (0): http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/3a674d9d762d74ecd2a2382c5c28a530820d38bf2bd086c2789cb683d18b2785/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/3a674d9d762d74ecd2a2382c5c28a530820d38bf2bd086c2789cb683d18b2785/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/exec/3a674d9d762d74ecd2a2382c5c28a530820d38bf2bd086c2789cb683d18b2785/json HTTP/1.1" 200 460 http://localhost:None "GET /v1.46/exec/3a674d9d762d74ecd2a2382c5c28a530820d38bf2bd086c2789cb683d18b2785/json HTTP/1.1" 200 460 [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-d', '172.16.8.9', '--sport', '2181', '-j', 'DROP'] (0): [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-d', '172.16.8.9', '--sport', '2181', '-j', 'DROP'] (0): Executing query create workload all; on node Executing query create workload all; on node Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query DROP DATABASE IF EXISTS `test_database_2` on instance Executing query DROP DATABASE IF EXISTS `test_database_2` on instance Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node1 Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node1 Executing query create workload X in all settings priority = 0; on node Executing query create workload X in all settings priority = 0; on node Executing query CREATE DATABASE `test_database_2` ENGINE = MaterializedPostgreSQL('172.16.5.2:5432', 'postgres_database_2', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE `test_database_2` ENGINE = MaterializedPostgreSQL('172.16.5.2:5432', 'postgres_database_2', 'postgres', 'mysecretpassword') on instance Executing query create workload Y in all settings priority = 1; on node Executing query create workload Y in all settings priority = 1; on node Executing query DROP TABLE IF EXISTS s3_test SYNC on node2 Executing query DROP TABLE IF EXISTS s3_test SYNC on node2 Executing query SHOW DATABASES on instance Executing query SHOW DATABASES on instance Executing query create workload A1 in X settings priority = -1; on node Executing query create workload A1 in X settings priority = -1; on node Executing query INSERT INTO postgres_database_1.postgresql_replica_0 SELECT 50 + number, number from numbers(50) on instance Executing query INSERT INTO postgres_database_1.postgresql_replica_0 SELECT 50 + number, number from numbers(50) on instance Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node2 Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node2 Executing query create workload B1 in X settings priority = 1; on node Executing query create workload B1 in X settings priority = 1; on node run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query DROP TABLE IF EXISTS s3_test SYNC on node3 Executing query DROP TABLE IF EXISTS s3_test SYNC on node3 Executing query INSERT INTO postgres_database_1.postgresql_replica_1 SELECT 50 + number, number from numbers(50) on instance Executing query INSERT INTO postgres_database_1.postgresql_replica_1 SELECT 50 + number, number from numbers(50) on instance Stdout:8643 Stdout:8643 Executing query CREATE FUNCTION f1 AS (x, y) -> x + y on node1 Executing query CREATE FUNCTION f1 AS (x, y) -> x + y on node1 Executing query create workload C1 in Y settings priority = -1; on node Executing query create workload C1 in Y settings priority = -1; on node Executing query INSERT INTO postgres_database_1.postgresql_replica_2 SELECT 50 + number, number from numbers(50) on instance Executing query INSERT INTO postgres_database_1.postgresql_replica_2 SELECT 50 + number, number from numbers(50) on instance Stopping zookeeper node: zoo1 Stopping zookeeper node: zoo1 Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop zoo1] Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop zoo1] Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node3 Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node3 Executing query create workload D1 in Y settings priority = 1; on node Executing query create workload D1 in Y settings priority = 1; on node Executing query INSERT INTO postgres_database_1.postgresql_replica_3 SELECT 50 + number, number from numbers(50) on instance Executing query INSERT INTO postgres_database_1.postgresql_replica_3 SELECT 50 + number, number from numbers(50) on instance http://172.16.6.7:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 http://172.16.6.7:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 Executing query CREATE TABLE s3_test ON CLUSTER cluster ( dt Date, id Int64, data String, INDEX min_max (id) TYPE minmax GRANULARITY 3 ) ENGINE=ReplicatedMergeTree() PARTITION BY dt ORDER BY (dt, id) SETTINGS storage_policy='s3' on node1 Executing query CREATE TABLE s3_test ON CLUSTER cluster ( dt Date, id Int64, data String, INDEX min_max (id) TYPE minmax GRANULARITY 3 ) ENGINE=ReplicatedMergeTree() PARTITION BY dt ORDER BY (dt, id) SETTINGS storage_policy='s3' on node1 test_replicated_merge_tree_s3_zero_copy/test.py::test_s3_check_restore Executing query create workload A2 in X settings priority = -1; on node Executing query create workload A2 in X settings priority = -1; on node Executing query INSERT INTO postgres_database_1.postgresql_replica_4 SELECT 50 + number, number from numbers(50) on instance Executing query INSERT INTO postgres_database_1.postgresql_replica_4 SELECT 50 + number, number from numbers(50) on instance Executing query create workload B2 in X settings priority = 1; on node Executing query create workload B2 in X settings priority = 1; on node Executing query INSERT INTO postgres_database_2.postgresql_replica_0 SELECT 50 + number, number from numbers(50) on instance Executing query INSERT INTO postgres_database_2.postgresql_replica_0 SELECT 50 + number, number from numbers(50) on instance Executing query INSERT INTO s3_test VALUES ('2020-01-02',1,'MXBDstSCYE'),('2020-01-02',2,'LKZHXxCvcA') on node1 Executing query INSERT INTO s3_test VALUES ('2020-01-02',1,'MXBDstSCYE'),('2020-01-02',2,'LKZHXxCvcA') on node1 run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query create workload C2 in Y settings priority = -1; on node Executing query create workload C2 in Y settings priority = -1; on node Executing query INSERT INTO postgres_database_2.postgresql_replica_1 SELECT 50 + number, number from numbers(50) on instance Executing query INSERT INTO postgres_database_2.postgresql_replica_1 SELECT 50 + number, number from numbers(50) on instance Stdout:8643 Stdout:8643 Executing query create workload D2 in Y settings priority = 1; on node Executing query create workload D2 in Y settings priority = 1; on node Executing query INSERT INTO postgres_database_2.postgresql_replica_2 SELECT 50 + number, number from numbers(50) on instance Executing query INSERT INTO postgres_database_2.postgresql_replica_2 SELECT 50 + number, number from numbers(50) on instance Executing query drop workload A1; on node Executing query drop workload A1; on node Executing query DETACH TABLE s3_test; on node1 Executing query DETACH TABLE s3_test; on node1 run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:8643 Stdout:8643 Executing query INSERT INTO postgres_database_2.postgresql_replica_3 SELECT 50 + number, number from numbers(50) on instance Executing query INSERT INTO postgres_database_2.postgresql_replica_3 SELECT 50 + number, number from numbers(50) on instance Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Stopped Stopping zookeeper node: zoo2 Stopping zookeeper node: zoo2 Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop zoo2] Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop zoo2] Executing query SYSTEM DROP REPLICA '1' FROM TABLE s3_test; on node2 Executing query SYSTEM DROP REPLICA '1' FROM TABLE s3_test; on node2 Executing query drop workload A2; on node Executing query drop workload A2; on node Executing query INSERT INTO postgres_database_2.postgresql_replica_4 SELECT 50 + number, number from numbers(50) on instance Executing query INSERT INTO postgres_database_2.postgresql_replica_4 SELECT 50 + number, number from numbers(50) on instance Executing query INSERT INTO s3_test VALUES ('2020-01-02',1,'WopNAnuTsD'),('2020-01-02',2,'XdwfGSaNvg') on node2 Executing query INSERT INTO s3_test VALUES ('2020-01-02',1,'WopNAnuTsD'),('2020-01-02',2,'XdwfGSaNvg') on node2 Executing query drop workload B1; on node Executing query drop workload B1; on node Executing query SELECT * FROM `test_database_1`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database_1`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Executing query drop workload B2; on node Executing query drop workload B2; on node Executing query SHOW TABLES FROM `test_database_1` WHERE name = 'postgresql_replica_0' on instance Executing query SHOW TABLES FROM `test_database_1` WHERE name = 'postgresql_replica_0' on instance Executing query ATTACH TABLE s3_test; on node1 Executing query ATTACH TABLE s3_test; on node1 run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] No clickhouse process running. Start new one. No clickhouse process running. Start new one. http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw4-node-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw4-node-1/exec HTTP/1.1" 201 74 Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Stopped Stopping zookeeper node: zoo3 Stopping zookeeper node: zoo3 Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop zoo3] Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop zoo3] http://localhost:None "POST /v1.46/exec/5605345569dfbc86f1677c41befec9ce841eefc369d69d3d4c31bcf2f126a16c/start HTTP/1.1" 200 0 http://localhost:None "POST /v1.46/exec/5605345569dfbc86f1677c41befec9ce841eefc369d69d3d4c31bcf2f126a16c/start HTTP/1.1" 200 0 http://localhost:None "GET /v1.46/exec/5605345569dfbc86f1677c41befec9ce841eefc369d69d3d4c31bcf2f126a16c/json HTTP/1.1" 200 586 http://localhost:None "GET /v1.46/exec/5605345569dfbc86f1677c41befec9ce841eefc369d69d3d4c31bcf2f126a16c/json HTTP/1.1" 200 586 Executing query drop workload C1; on node Executing query drop workload C1; on node Executing query select * from `postgres_database_1`.`postgresql_replica_0` order by key; on instance Executing query select * from `postgres_database_1`.`postgresql_replica_0` order by key; on instance Executing query SYSTEM RESTORE REPLICA s3_test; on node1 Executing query SYSTEM RESTORE REPLICA s3_test; on node1 Executing query drop workload C2; on node Executing query drop workload C2; on node Executing query select * from `test_database_1`.`postgresql_replica_0` order by key; on instance Executing query select * from `test_database_1`.`postgresql_replica_0` order by key; on instance Executing query SELECT count() FROM system.replication_queue WHERE table='s3_test' and type='ATTACH_PART' on node1 Executing query SELECT count() FROM system.replication_queue WHERE table='s3_test' and type='ATTACH_PART' on node1 Executing query drop workload D1; on node Executing query drop workload D1; on node Executing query SELECT * FROM `test_database_1`.`postgresql_replica_1` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database_1`.`postgresql_replica_1` LIMIT 1 FORMAT Null on instance Executing query DROP TABLE IF EXISTS s3_test SYNC on node1 Executing query DROP TABLE IF EXISTS s3_test SYNC on node1 [gw5] PASSED test_replicated_merge_tree_s3_zero_copy/test.py::test_s3_check_restore Executing query drop workload D2; on node Executing query drop workload D2; on node Executing query SHOW TABLES FROM `test_database_1` WHERE name = 'postgresql_replica_1' on instance Executing query SHOW TABLES FROM `test_database_1` WHERE name = 'postgresql_replica_1' on instance Executing query create workload Z in all; on node Executing query create workload Z in all; on node Executing query select * from `postgres_database_1`.`postgresql_replica_1` order by key; on instance Executing query select * from `postgres_database_1`.`postgresql_replica_1` order by key; on instance Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node1 Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node1 run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:9444 Stdout:9444 Clickhouse process running. Clickhouse process running. run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:9444 Stdout:9444 Executing query select 20 on node Executing query select 20 on node Executing query create workload A1 in Z settings priority = -1; on node Executing query create workload A1 in Z settings priority = -1; on node Executing query select * from `test_database_1`.`postgresql_replica_1` order by key; on instance Executing query select * from `test_database_1`.`postgresql_replica_1` order by key; on instance Executing query DROP TABLE IF EXISTS s3_test SYNC on node2 Executing query DROP TABLE IF EXISTS s3_test SYNC on node2 Stderr: Container roottestrenamecolumn-gw0-node1-1 Stopping Stderr: Container roottestrenamecolumn-gw0-node1-1 Stopping Stderr: Container roottestrenamecolumn-gw0-node2-1 Stopping Stderr: Container roottestrenamecolumn-gw0-node2-1 Stopping Stderr: Container roottestrenamecolumn-gw0-node3-1 Stopping Stderr: Container roottestrenamecolumn-gw0-node3-1 Stopping Stderr: Container roottestrenamecolumn-gw0-node4-1 Stopping Stderr: Container roottestrenamecolumn-gw0-node4-1 Stopping Stderr: Container roottestrenamecolumn-gw0-node2-1 Stopped Stderr: Container roottestrenamecolumn-gw0-node2-1 Stopped Stderr: Container roottestrenamecolumn-gw0-node1-1 Stopped Stderr: Container roottestrenamecolumn-gw0-node1-1 Stopped Stderr: Container roottestrenamecolumn-gw0-node3-1 Stopped Stderr: Container roottestrenamecolumn-gw0-node3-1 Stopped Stderr: Container roottestrenamecolumn-gw0-node4-1 Stopped Stderr: Container roottestrenamecolumn-gw0-node4-1 Stopped Stderr: Container roottestrenamecolumn-gw0-zoo2-1 Stopping Stderr: Container roottestrenamecolumn-gw0-zoo2-1 Stopping Stderr: Container roottestrenamecolumn-gw0-zoo3-1 Stopping Stderr: Container roottestrenamecolumn-gw0-zoo3-1 Stopping Stderr: Container roottestrenamecolumn-gw0-zoo1-1 Stopping Stderr: Container roottestrenamecolumn-gw0-zoo1-1 Stopping Stderr: Container roottestrenamecolumn-gw0-zoo1-1 Stopped Stderr: Container roottestrenamecolumn-gw0-zoo1-1 Stopped Stderr: Container roottestrenamecolumn-gw0-zoo2-1 Stopped Stderr: Container roottestrenamecolumn-gw0-zoo2-1 Stopped Stderr: Container roottestrenamecolumn-gw0-zoo3-1 Stopped Stderr: Container roottestrenamecolumn-gw0-zoo3-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node3/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node3/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node3/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node3/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node4/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node4/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node4/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node4/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/.env --project-name roottestrenamecolumn-gw0 --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node3/docker-compose.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node4/docker-compose.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/.env --project-name roottestrenamecolumn-gw0 --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node3/docker-compose.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw0/node4/docker-compose.yml down --volumes] Executing query create workload A2 in Z settings priority = -1; on node Executing query create workload A2 in Z settings priority = -1; on node Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node2 Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node2 Executing query SELECT * FROM `test_database_1`.`postgresql_replica_2` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database_1`.`postgresql_replica_2` LIMIT 1 FORMAT Null on instance Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node_no_proxy-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node_no_proxy-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node_no_proxy-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node_no_proxy-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-resolver-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-resolver-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-env_node-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-env_node-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-env_node_no_proxy-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-env_node_no_proxy-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node_no_proxy-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node_no_proxy-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node_no_proxy-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node_no_proxy-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-env_node-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-env_node-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-env_node_no_proxy-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-env_node_no_proxy-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-minio1-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-minio1-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-minio1-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-minio1-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-resolver-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-resolver-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy1-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy1-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy2-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy2-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy2-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy2-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy1-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy1-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node_no_proxy/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node_no_proxy/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node_no_proxy/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node_no_proxy/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node_no_proxy/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node_no_proxy/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node_no_proxy/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node_no_proxy/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node_no_proxy/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node_no_proxy/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node_no_proxy/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node_no_proxy/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/.env --project-name roottests3tablefunctionwithhttpproxy-gw6 --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node_no_proxy/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node_no_proxy/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node_no_proxy/docker-compose.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/.env --project-name roottests3tablefunctionwithhttpproxy-gw6 --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/remote_proxy_node_no_proxy/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/proxy_list_node_no_proxy/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/env_node_no_proxy/docker-compose.yml down --volumes] Executing query create workload A3 in Z settings priority = -1; on node Executing query create workload A3 in Z settings priority = -1; on node Executing query DROP TABLE IF EXISTS s3_test SYNC on node3 Executing query DROP TABLE IF EXISTS s3_test SYNC on node3 Executing query SHOW TABLES FROM `test_database_1` WHERE name = 'postgresql_replica_2' on instance Executing query SHOW TABLES FROM `test_database_1` WHERE name = 'postgresql_replica_2' on instance Executing query create workload B1 in Z settings priority = 1; on node Executing query create workload B1 in Z settings priority = 1; on node Executing query select 20 on node Executing query select 20 on node Executing query select * from `postgres_database_1`.`postgresql_replica_2` order by key; on instance Executing query select * from `postgres_database_1`.`postgresql_replica_2` order by key; on instance Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node3 Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node3 Executing query create workload B2 in Z settings priority = 1; on node Executing query create workload B2 in Z settings priority = 1; on node Stderr: Container roottestrenamecolumn-gw0-node4-1 Stopping Stderr: Container roottestrenamecolumn-gw0-node4-1 Stopping Stderr: Container roottestrenamecolumn-gw0-node1-1 Stopping Stderr: Container roottestrenamecolumn-gw0-node1-1 Stopping Stderr: Container roottestrenamecolumn-gw0-node2-1 Stopping Stderr: Container roottestrenamecolumn-gw0-node2-1 Stopping Stderr: Container roottestrenamecolumn-gw0-node3-1 Stopping Stderr: Container roottestrenamecolumn-gw0-node3-1 Stopping Stderr: Container roottestrenamecolumn-gw0-node4-1 Stopped Stderr: Container roottestrenamecolumn-gw0-node4-1 Stopped Stderr: Container roottestrenamecolumn-gw0-node4-1 Removing Stderr: Container roottestrenamecolumn-gw0-node4-1 Removing Stderr: Container roottestrenamecolumn-gw0-node2-1 Stopped Stderr: Container roottestrenamecolumn-gw0-node2-1 Stopped Stderr: Container roottestrenamecolumn-gw0-node2-1 Removing Stderr: Container roottestrenamecolumn-gw0-node2-1 Removing Stderr: Container roottestrenamecolumn-gw0-node3-1 Stopped Stderr: Container roottestrenamecolumn-gw0-node3-1 Stopped Stderr: Container roottestrenamecolumn-gw0-node3-1 Removing Stderr: Container roottestrenamecolumn-gw0-node3-1 Removing Stderr: Container roottestrenamecolumn-gw0-node1-1 Stopped Stderr: Container roottestrenamecolumn-gw0-node1-1 Stopped Stderr: Container roottestrenamecolumn-gw0-node1-1 Removing Stderr: Container roottestrenamecolumn-gw0-node1-1 Removing Stderr: Container roottestrenamecolumn-gw0-node2-1 Removed Stderr: Container roottestrenamecolumn-gw0-node2-1 Removed Stderr: Container roottestrenamecolumn-gw0-node1-1 Removed Stderr: Container roottestrenamecolumn-gw0-node1-1 Removed Stderr: Container roottestrenamecolumn-gw0-node3-1 Removed Stderr: Container roottestrenamecolumn-gw0-node3-1 Removed Stderr: Container roottestrenamecolumn-gw0-node4-1 Removed Stderr: Container roottestrenamecolumn-gw0-node4-1 Removed Stderr: Container roottestrenamecolumn-gw0-zoo3-1 Stopping Stderr: Container roottestrenamecolumn-gw0-zoo3-1 Stopping Stderr: Container roottestrenamecolumn-gw0-zoo1-1 Stopping Stderr: Container roottestrenamecolumn-gw0-zoo1-1 Stopping Stderr: Container roottestrenamecolumn-gw0-zoo2-1 Stopping Stderr: Container roottestrenamecolumn-gw0-zoo2-1 Stopping Stderr: Container roottestrenamecolumn-gw0-zoo1-1 Stopped Stderr: Container roottestrenamecolumn-gw0-zoo1-1 Stopped Stderr: Container roottestrenamecolumn-gw0-zoo1-1 Removing Stderr: Container roottestrenamecolumn-gw0-zoo1-1 Removing Stderr: Container roottestrenamecolumn-gw0-zoo2-1 Stopped Stderr: Container roottestrenamecolumn-gw0-zoo2-1 Stopped Stderr: Container roottestrenamecolumn-gw0-zoo2-1 Removing Stderr: Container roottestrenamecolumn-gw0-zoo2-1 Removing Stderr: Container roottestrenamecolumn-gw0-zoo3-1 Stopped Stderr: Container roottestrenamecolumn-gw0-zoo3-1 Stopped Stderr: Container roottestrenamecolumn-gw0-zoo3-1 Removing Stderr: Container roottestrenamecolumn-gw0-zoo3-1 Removing Stderr: Container roottestrenamecolumn-gw0-zoo1-1 Removed Stderr: Container roottestrenamecolumn-gw0-zoo1-1 Removed Stderr: Container roottestrenamecolumn-gw0-zoo3-1 Removed Stderr: Container roottestrenamecolumn-gw0-zoo3-1 Removed Stderr: Container roottestrenamecolumn-gw0-zoo2-1 Removed Stderr: Container roottestrenamecolumn-gw0-zoo2-1 Removed Stderr: Network roottestrenamecolumn-gw0_default Removing Stderr: Network roottestrenamecolumn-gw0_default Removing Stderr: Network roottestrenamecolumn-gw0_default Removed Stderr: Network roottestrenamecolumn-gw0_default Removed Cleanup called Cleanup called Docker networks for project roottestrenamecolumn-gw0 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestrenamecolumn-gw0 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestrenamecolumn-gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestrenamecolumn-gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestrenamecolumn-gw0 are DRIVER VOLUME NAME Docker volumes for project roottestrenamecolumn-gw0 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestrenamecolumn-gw0-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestrenamecolumn-gw0-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestrenamecolumn-gw0 No running containers for project: roottestrenamecolumn-gw0 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] [gw4] PASSED test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB PRIMARY KEY(key); DROP TABLE test; on node Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB PRIMARY KEY(key); DROP TABLE test; on node Executing query select * from `test_database_1`.`postgresql_replica_2` order by key; on instance Executing query select * from `test_database_1`.`postgresql_replica_2` order by key; on instance Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stderr: replica3 Skipped - Image is already being pulled by replica2 Stderr: replica3 Skipped - Image is already being pulled by replica2 Stderr: replica1 Skipped - Image is already being pulled by replica2 Stderr: replica1 Skipped - Image is already being pulled by replica2 Stderr: zoo1 Skipped - Image is already being pulled by replica2 Stderr: zoo1 Skipped - Image is already being pulled by replica2 Stderr: zoo2 Skipped - Image is already being pulled by replica2 Stderr: zoo2 Skipped - Image is already being pulled by replica2 Stderr: zoo3 Skipped - Image is already being pulled by replica2 Stderr: zoo3 Skipped - Image is already being pulled by replica2 Stderr: mysql80 Pulling Stderr: mysql80 Pulling Stderr: replica2 Pulling Stderr: replica2 Pulling Stderr: replica2 Pulled Stderr: replica2 Pulled Stderr: mysql80 Pulled Stderr: mysql80 Pulled Setup ZooKeeper Setup ZooKeeper Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/keeper1/log', '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/keeper1/config', '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/keeper1/coordination', '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/keeper2/log', '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/keeper2/config', '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/keeper2/coordination', '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/keeper3/log', '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/keeper3/config', '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/keeper3/coordination'] Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/keeper1/log', '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/keeper1/config', '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/keeper1/coordination', '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/keeper2/log', '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/keeper2/config', '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/keeper2/coordination', '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/keeper3/log', '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/keeper3/config', '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/keeper3/coordination'] Command:[docker compose --project-name roottestrestoreexternalengines-gw9 --env-file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Command:[docker compose --project-name roottestrestoreexternalengines-gw9 --env-file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Stdout:9 Stdout:9 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 9 Volumes pruned: 9 test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers Running tests in /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/test.py Running tests in /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/test.py Cluster start called. is_up=False Cluster start called. is_up=False Docker networks for project roottestreloadauxiliaryzookeepers-gw0 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreloadauxiliaryzookeepers-gw0 are NETWORK ID NAME DRIVER SCOPE http://172.16.6.7:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 http://172.16.6.7:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/.env --project-name roottestreplicatedmergetrees3zerocopy-gw5 --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node3/docker-compose.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/.env --project-name roottestreplicatedmergetrees3zerocopy-gw5 --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node3/docker-compose.yml stop --timeout 20] Docker containers for project roottestreloadauxiliaryzookeepers-gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreloadauxiliaryzookeepers-gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreloadauxiliaryzookeepers-gw0 are DRIVER VOLUME NAME Docker volumes for project roottestreloadauxiliaryzookeepers-gw0 are DRIVER VOLUME NAME Cleanup called Cleanup called http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/a2eeea7fe452444add1736648ea20896a6093aaac9ea51adcf3aa21a00def58a/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/a2eeea7fe452444add1736648ea20896a6093aaac9ea51adcf3aa21a00def58a/start HTTP/1.1" 101 0 Docker networks for project roottestreloadauxiliaryzookeepers-gw0 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreloadauxiliaryzookeepers-gw0 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestreloadauxiliaryzookeepers-gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreloadauxiliaryzookeepers-gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreloadauxiliaryzookeepers-gw0 are DRIVER VOLUME NAME Docker volumes for project roottestreloadauxiliaryzookeepers-gw0 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestreloadauxiliaryzookeepers-gw0-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestreloadauxiliaryzookeepers-gw0-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestreloadauxiliaryzookeepers-gw0 No running containers for project: roottestreloadauxiliaryzookeepers-gw0 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] http://localhost:None "GET /v1.46/exec/a2eeea7fe452444add1736648ea20896a6093aaac9ea51adcf3aa21a00def58a/json HTTP/1.1" 200 456 http://localhost:None "GET /v1.46/exec/a2eeea7fe452444add1736648ea20896a6093aaac9ea51adcf3aa21a00def58a/json HTTP/1.1" 200 456 [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-d', '172.16.8.9', '--sport', '2181', '-j', 'DROP'] (0): [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-d', '172.16.8.9', '--sport', '2181', '-j', 'DROP'] (0): http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/c47f00d3ad4c7da73ff61cdcfad2d7923f1b3e2b9e47419ba24e91d6610e8326/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/c47f00d3ad4c7da73ff61cdcfad2d7923f1b3e2b9e47419ba24e91d6610e8326/start HTTP/1.1" 101 0 Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:9 Stdout:9 Command:[docker volume prune -f] Command:[docker volume prune -f] [gw4] PASSED test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB PRIMARY KEY(key); DROP TABLE test; on node Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB PRIMARY KEY(key); DROP TABLE test; on node Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 9 Volumes pruned: 9 Setup directory for instance: node Setup directory for instance: node Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Executing query SELECT * FROM `test_database_1`.`postgresql_replica_3` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database_1`.`postgresql_replica_3` LIMIT 1 FORMAT Null on instance Generate and write macros file Generate and write macros file Copy custom test config files [] to /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/node/configs/config.d Copy custom test config files [] to /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/node/configs/config.d Setup database dir /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/node/database Setup database dir /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/node/database Setup logs dir /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/node/logs Setup logs dir /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/node/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/keeper3/coordination'} stored in /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/keeper3/coordination'} stored in /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/.env --project-name roottestreloadauxiliaryzookeepers-gw0 --file /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/.env --project-name roottestreloadauxiliaryzookeepers-gw0 --file /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml pull] http://localhost:None "GET /v1.46/exec/c47f00d3ad4c7da73ff61cdcfad2d7923f1b3e2b9e47419ba24e91d6610e8326/json HTTP/1.1" 200 456 http://localhost:None "GET /v1.46/exec/c47f00d3ad4c7da73ff61cdcfad2d7923f1b3e2b9e47419ba24e91d6610e8326/json HTTP/1.1" 200 456 [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-s', '172.16.8.9', '--dport', '2181', '-j', 'DROP'] (0): [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-s', '172.16.8.9', '--dport', '2181', '-j', 'DROP'] (0): Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node [gw4] PASSED test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB PRIMARY KEY(key); DROP TABLE test; on node Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB PRIMARY KEY(key); DROP TABLE test; on node Executing query SHOW TABLES FROM `test_database_1` WHERE name = 'postgresql_replica_3' on instance Executing query SHOW TABLES FROM `test_database_1` WHERE name = 'postgresql_replica_3' on instance Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-env_node_no_proxy-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-env_node_no_proxy-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-env_node-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-env_node-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node_no_proxy-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node_no_proxy-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node_no_proxy-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node_no_proxy-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-resolver-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-resolver-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node-1 Removing Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node-1 Removing Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node-1 Removing Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node-1 Removing Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-env_node_no_proxy-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-env_node_no_proxy-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-env_node_no_proxy-1 Removing Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-env_node_no_proxy-1 Removing Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-env_node-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-env_node-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-env_node-1 Removing Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-env_node-1 Removing Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node_no_proxy-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node_no_proxy-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node_no_proxy-1 Removing Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node_no_proxy-1 Removing Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node_no_proxy-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node_no_proxy-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node_no_proxy-1 Removing Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node_no_proxy-1 Removing Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-resolver-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-resolver-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-resolver-1 Removing Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-resolver-1 Removing Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-env_node_no_proxy-1 Removed Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-env_node_no_proxy-1 Removed Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node_no_proxy-1 Removed Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node_no_proxy-1 Removed Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-env_node-1 Removed Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-env_node-1 Removed Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node-1 Removed Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy_list_node-1 Removed Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-resolver-1 Removed Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-resolver-1 Removed Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node-1 Removed Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node-1 Removed Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node_no_proxy-1 Removed Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-remote_proxy_node_no_proxy-1 Removed Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-minio1-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-minio1-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-minio1-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-minio1-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-minio1-1 Removing Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-minio1-1 Removing Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-minio1-1 Removed Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-minio1-1 Removed Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy2-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy2-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy1-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy1-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy2-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy2-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy2-1 Removing Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy2-1 Removing Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy1-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy1-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy1-1 Removing Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy1-1 Removing Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy2-1 Removed Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy2-1 Removed Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy1-1 Removed Stderr: Container roottests3tablefunctionwithhttpproxy-gw6-proxy1-1 Removed Stderr: Volume roottests3tablefunctionwithhttpproxy-gw6_data1-1 Removing Stderr: Volume roottests3tablefunctionwithhttpproxy-gw6_data1-1 Removing Stderr: Network roottests3tablefunctionwithhttpproxy-gw6_default Removing Stderr: Network roottests3tablefunctionwithhttpproxy-gw6_default Removing Stderr: Volume roottests3tablefunctionwithhttpproxy-gw6_data1-1 Removed Stderr: Volume roottests3tablefunctionwithhttpproxy-gw6_data1-1 Removed Stderr: Network roottests3tablefunctionwithhttpproxy-gw6_default Removed Stderr: Network roottests3tablefunctionwithhttpproxy-gw6_default Removed Cleanup called Cleanup called Docker networks for project roottests3tablefunctionwithhttpproxy-gw6 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3tablefunctionwithhttpproxy-gw6 are NETWORK ID NAME DRIVER SCOPE Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 Docker containers for project roottests3tablefunctionwithhttpproxy-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3tablefunctionwithhttpproxy-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3tablefunctionwithhttpproxy-gw6 are DRIVER VOLUME NAME Docker volumes for project roottests3tablefunctionwithhttpproxy-gw6 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottests3tablefunctionwithhttpproxy-gw6-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottests3tablefunctionwithhttpproxy-gw6-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottests3tablefunctionwithhttpproxy-gw6 No running containers for project: roottests3tablefunctionwithhttpproxy-gw6 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:9 Stdout:9 Command:[docker volume prune -f] Command:[docker volume prune -f] Executing query select * from `postgres_database_1`.`postgresql_replica_3` order by key; on instance Executing query select * from `postgres_database_1`.`postgresql_replica_3` order by key; on instance Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 9 Volumes pruned: 9 test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3] ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 ENV HOSTNAME e7837a770c02 ENV HOSTNAME e7837a770c02 ENV SHLVL 0 ENV SHLVL 0 ENV HOME /root ENV HOME /root ENV OLDPWD / ENV OLDPWD / ENV DOCKER_HELPER_TAG 5dc43a6382f0 ENV DOCKER_HELPER_TAG 5dc43a6382f0 ENV PYTHONUNBUFFERED 1 ENV PYTHONUNBUFFERED 1 ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e ENV UBSAN_OPTIONS print_stacktrace=1 ENV UBSAN_OPTIONS print_stacktrace=1 ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_postgresql_replica_database_engine_1/test.py::test_different_data_types test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries test_postgresql_replica_database_engine_1/test.py::test_multiple_databases test_postgresql_replica_database_engine_1/test.py::test_quoting_1 test_postgresql_replica_database_engine_1/test.py::test_quoting_2 test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index test_postgresql_replica_database_engine_1/test.py::test_replicating_dml test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_single_transaction test_postgresql_replica_database_engine_1/test.py::test_table_schema_changes test_postgresql_replica_database_engine_1/test.py::test_user_managed_slots test_postgresql_replica_database_engine_1/test.py::test_virtual_columns test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers test_reload_client_certificate/test.py::test_correct_cn_cert test_reload_client_certificate/test.py::test_wrong_cn_cert test_reload_clusters_config/test.py::test_add_cluster test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_simple_reload test_reload_clusters_config/test.py::test_update_one_cluster test_remote_prewhere/test.py::test_remote test_remove_stale_moving_parts/test.py::test_remove_stale_moving_parts_without_zookeeper test_rename_column/test.py::test_rename_distributed test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select test_rename_column/test.py::test_rename_parallel test_rename_column/test.py::test_rename_parallel_same_node test_rename_column/test.py::test_rename_with_parallel_insert test_rename_column/test.py::test_rename_with_parallel_merges test_rename_column/test.py::test_rename_with_parallel_select test_rename_column/test.py::test_rename_with_parallel_slow_insert test_rename_column/test.py::test_rename_with_parallel_ttl_delete test_rename_column/test.py::test_rename_with_parallel_ttl_move test_replicated_merge_tree_compatibility/test.py::test_replicated_merge_tree_defaults_compatibility test_replicated_merge_tree_encrypted_disk/test.py::test_different_keys test_replicated_merge_tree_encrypted_disk/test.py::test_same_keys test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl test_replicated_merge_tree_s3_zero_copy/test.py::test_drop_table 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[0-16]' 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[8192-12]' test_replicated_merge_tree_s3_zero_copy/test.py::test_s3_check_restore test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns test_replicated_user_defined_functions/test.py::test_create_and_drop 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[false-expected_raise1]' 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[true-expected_raise0]' test_replicated_user_defined_functions/test.py::test_create_and_replace test_replicated_user_defined_functions/test.py::test_drop_if_exists test_replicated_user_defined_functions/test.py::test_reload_zookeeper test_replicated_user_defined_functions/test.py::test_replication test_replicated_user_defined_functions/test.py::test_replication_replace_by_another_node_after_creation test_replicated_user_defined_functions/test.py::test_server_restart test_replicated_user_defined_functions/test.py::test_start_without_zookeeper test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart test_restore_external_engines/test.py::test_restore_table test_restore_external_engines/test.py::test_restore_table_null test_rocksdb_options/test.py::test_invalid_block_based_table_options test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options test_s3_imds/test_session_token.py::test_credentials_from_metadata test_s3_imds/test_simple.py::test_credentials_from_metadata test_s3_latency_log/test.py::test_latency_log test_s3_low_cardinality_right_border/test.py::test_s3_right_border test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 test_s3_storage_class/test.py::test_s3_storage_class_right 'test_s3_storage_conf_new_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver]' test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy_no_proxy test_scheduler/test.py::test_create_workload test_scheduler/test.py::test_merge_workload test_scheduler/test.py::test_merge_workload_change test_scheduler/test.py::test_merge_workload_override test_scheduler/test.py::test_mutate_workload test_scheduler/test.py::test_mutation_workload_change test_scheduler/test.py::test_mutation_workload_override test_scheduler/test.py::test_resource_any_disk test_scheduler/test.py::test_resource_read_and_write test_scheduler/test.py::test_s3_disk test_scheduler/test.py::test_s3_resource_request_granularity test_scheduler/test.py::test_throw_on_unknown_workload test_scheduler/test.py::test_workload_entity_keeper_storage test_scheduler/test.py::test_workload_hierarchy_changes test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_settings_constraints_distributed/test.py::test_select_clamps_settings -vvv -ss ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_postgresql_replica_database_engine_1/test.py::test_different_data_types test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries test_postgresql_replica_database_engine_1/test.py::test_multiple_databases test_postgresql_replica_database_engine_1/test.py::test_quoting_1 test_postgresql_replica_database_engine_1/test.py::test_quoting_2 test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index test_postgresql_replica_database_engine_1/test.py::test_replicating_dml test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_single_transaction test_postgresql_replica_database_engine_1/test.py::test_table_schema_changes test_postgresql_replica_database_engine_1/test.py::test_user_managed_slots test_postgresql_replica_database_engine_1/test.py::test_virtual_columns test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers test_reload_client_certificate/test.py::test_correct_cn_cert test_reload_client_certificate/test.py::test_wrong_cn_cert test_reload_clusters_config/test.py::test_add_cluster test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_simple_reload test_reload_clusters_config/test.py::test_update_one_cluster test_remote_prewhere/test.py::test_remote test_remove_stale_moving_parts/test.py::test_remove_stale_moving_parts_without_zookeeper test_rename_column/test.py::test_rename_distributed test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select test_rename_column/test.py::test_rename_parallel test_rename_column/test.py::test_rename_parallel_same_node test_rename_column/test.py::test_rename_with_parallel_insert test_rename_column/test.py::test_rename_with_parallel_merges test_rename_column/test.py::test_rename_with_parallel_select test_rename_column/test.py::test_rename_with_parallel_slow_insert test_rename_column/test.py::test_rename_with_parallel_ttl_delete test_rename_column/test.py::test_rename_with_parallel_ttl_move test_replicated_merge_tree_compatibility/test.py::test_replicated_merge_tree_defaults_compatibility test_replicated_merge_tree_encrypted_disk/test.py::test_different_keys test_replicated_merge_tree_encrypted_disk/test.py::test_same_keys test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl test_replicated_merge_tree_s3_zero_copy/test.py::test_drop_table 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[0-16]' 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[8192-12]' test_replicated_merge_tree_s3_zero_copy/test.py::test_s3_check_restore test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns test_replicated_user_defined_functions/test.py::test_create_and_drop 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[false-expected_raise1]' 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[true-expected_raise0]' test_replicated_user_defined_functions/test.py::test_create_and_replace test_replicated_user_defined_functions/test.py::test_drop_if_exists test_replicated_user_defined_functions/test.py::test_reload_zookeeper test_replicated_user_defined_functions/test.py::test_replication test_replicated_user_defined_functions/test.py::test_replication_replace_by_another_node_after_creation test_replicated_user_defined_functions/test.py::test_server_restart test_replicated_user_defined_functions/test.py::test_start_without_zookeeper test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart test_restore_external_engines/test.py::test_restore_table test_restore_external_engines/test.py::test_restore_table_null test_rocksdb_options/test.py::test_invalid_block_based_table_options test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options test_s3_imds/test_session_token.py::test_credentials_from_metadata test_s3_imds/test_simple.py::test_credentials_from_metadata test_s3_latency_log/test.py::test_latency_log test_s3_low_cardinality_right_border/test.py::test_s3_right_border test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 test_s3_storage_class/test.py::test_s3_storage_class_right 'test_s3_storage_conf_new_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver]' test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy_no_proxy test_scheduler/test.py::test_create_workload test_scheduler/test.py::test_merge_workload test_scheduler/test.py::test_merge_workload_change test_scheduler/test.py::test_merge_workload_override test_scheduler/test.py::test_mutate_workload test_scheduler/test.py::test_mutation_workload_change test_scheduler/test.py::test_mutation_workload_override test_scheduler/test.py::test_resource_any_disk test_scheduler/test.py::test_resource_read_and_write test_scheduler/test.py::test_s3_disk test_scheduler/test.py::test_s3_resource_request_granularity test_scheduler/test.py::test_throw_on_unknown_workload test_scheduler/test.py::test_workload_entity_keeper_storage test_scheduler/test.py::test_workload_hierarchy_changes test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_settings_constraints_distributed/test.py::test_select_clamps_settings -vvv -ss ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge ENV COMPOSE_HTTP_TIMEOUT 600 ENV COMPOSE_HTTP_TIMEOUT 600 ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 ENV CLICKHOUSE_USE_OLD_ANALYZER 1 ENV CLICKHOUSE_USE_OLD_ANALYZER 1 ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ENV DOCKER_KERBERIZED_HADOOP_TAG latest ENV DOCKER_KERBERIZED_HADOOP_TAG latest ENV DOCKER_CHANNEL stable ENV DOCKER_CHANNEL stable ENV DOCKER_CLIENT_TIMEOUT 300 ENV DOCKER_CLIENT_TIMEOUT 300 [gw4] PASSED test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e ENV PWD /ClickHouse/tests/integration ENV PWD /ClickHouse/tests/integration ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config ENV TZ Etc/UTC ENV TZ Etc/UTC ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java ENV DOCKER_BASE_TAG 8b2301119731 ENV DOCKER_BASE_TAG 8b2301119731 ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 ENV LC_CTYPE C.UTF-8 ENV LC_CTYPE C.UTF-8 ENV INTEGRATION_TESTS_RUN_ID 0 ENV INTEGRATION_TESTS_RUN_ID 0 ENV WORKER_FREE_PORTS 30300 30301 30302 30303 30304 30305 30306 30307 30308 30309 30310 30311 30312 30313 30314 30315 30316 30317 30318 30319 30320 30321 30322 30323 30324 30325 30326 30327 30328 30329 30330 30331 30332 30333 30334 30335 30336 30337 30338 30339 30340 30341 30342 30343 30344 30345 30346 30347 30348 30349 ENV WORKER_FREE_PORTS 30300 30301 30302 30303 30304 30305 30306 30307 30308 30309 30310 30311 30312 30313 30314 30315 30316 30317 30318 30319 30320 30321 30322 30323 30324 30325 30326 30327 30328 30329 30330 30331 30332 30333 30334 30335 30336 30337 30338 30339 30340 30341 30342 30343 30344 30345 30346 30347 30348 30349 ENV PYTEST_XDIST_TESTRUNUID abec1c7124634c26ad4fb6ef8710757d ENV PYTEST_XDIST_TESTRUNUID abec1c7124634c26ad4fb6ef8710757d ENV PYTEST_XDIST_WORKER gw6 ENV PYTEST_XDIST_WORKER gw6 ENV PYTEST_XDIST_WORKER_COUNT 10 ENV PYTEST_XDIST_WORKER_COUNT 10 ENV SSL_CERT_FILE /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/minio/certs/public.crt ENV SSL_CERT_FILE /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw6/minio/certs/public.crt ENV PYTEST_CURRENT_TEST test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3] (setup) ENV PYTEST_CURRENT_TEST test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3] (setup) CLUSTER INIT base_config_dir:/clickhouse-config CLUSTER INIT base_config_dir:/clickhouse-config clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log Cluster name: project_name:roottests3storageconfproxy-gw6. Added instance name:node tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/.env', '--project-name', 'roottests3storageconfproxy-gw6', '--file', '/ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Cluster name: project_name:roottests3storageconfproxy-gw6. Added instance name:node tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/.env', '--project-name', 'roottests3storageconfproxy-gw6', '--file', '/ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Starting cluster... Starting cluster... Running tests in /ClickHouse/tests/integration/test_s3_storage_conf_proxy/test.py Running tests in /ClickHouse/tests/integration/test_s3_storage_conf_proxy/test.py Cluster start called. is_up=False Cluster start called. is_up=False Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB PRIMARY KEY(key); DROP TABLE test; on node Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB PRIMARY KEY(key); DROP TABLE test; on node Docker networks for project roottests3storageconfproxy-gw6 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3storageconfproxy-gw6 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3storageconfproxy-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3storageconfproxy-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3storageconfproxy-gw6 are DRIVER VOLUME NAME Docker volumes for project roottests3storageconfproxy-gw6 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker networks for project roottests3storageconfproxy-gw6 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3storageconfproxy-gw6 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3storageconfproxy-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3storageconfproxy-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3storageconfproxy-gw6 are DRIVER VOLUME NAME Docker volumes for project roottests3storageconfproxy-gw6 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottests3storageconfproxy-gw6-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottests3storageconfproxy-gw6-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottests3storageconfproxy-gw6 No running containers for project: roottests3storageconfproxy-gw6 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Executing query select * from `test_database_1`.`postgresql_replica_3` order by key; on instance Executing query select * from `test_database_1`.`postgresql_replica_3` order by key; on instance Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:9 Stdout:9 Command:[docker volume prune -f] Command:[docker volume prune -f] Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB(0) PRIMARY KEY(key); DROP TABLE test; on node Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB(0) PRIMARY KEY(key); DROP TABLE test; on node Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 9 Volumes pruned: 9 Setup directory for instance: node Setup directory for instance: node Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_s3_storage_conf_proxy/configs/config.d/storage_conf.xml'] to /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/node/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_s3_storage_conf_proxy/configs/config.d/storage_conf.xml'] to /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/node/configs/config.d Setup database dir /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/node/database Setup database dir /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/node/database Setup logs dir /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/node/logs Setup logs dir /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/node/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/.env --project-name roottests3storageconfproxy-gw6 --file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/.env --project-name roottests3storageconfproxy-gw6 --file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml pull] Stderr:time="2025-04-02T02:54:27Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:54:27Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottestrestoreexternalengines-gw9_default Creating Stderr: Network roottestrestoreexternalengines-gw9_default Creating Stderr: Network roottestrestoreexternalengines-gw9_default Created Stderr: Network roottestrestoreexternalengines-gw9_default Created Stderr: Container roottestrestoreexternalengines-gw9-zoo2-1 Creating Stderr: Container roottestrestoreexternalengines-gw9-zoo2-1 Creating Stderr: Container roottestrestoreexternalengines-gw9-zoo3-1 Creating Stderr: Container roottestrestoreexternalengines-gw9-zoo3-1 Creating Stderr: Container roottestrestoreexternalengines-gw9-zoo1-1 Creating Stderr: Container roottestrestoreexternalengines-gw9-zoo1-1 Creating Stderr: Container roottestrestoreexternalengines-gw9-zoo1-1 Created Stderr: Container roottestrestoreexternalengines-gw9-zoo1-1 Created Stderr: Container roottestrestoreexternalengines-gw9-zoo2-1 Created Stderr: Container roottestrestoreexternalengines-gw9-zoo2-1 Created Stderr: Container roottestrestoreexternalengines-gw9-zoo3-1 Created Stderr: Container roottestrestoreexternalengines-gw9-zoo3-1 Created Stderr: Container roottestrestoreexternalengines-gw9-zoo2-1 Starting Stderr: Container roottestrestoreexternalengines-gw9-zoo2-1 Starting Stderr: Container roottestrestoreexternalengines-gw9-zoo3-1 Starting Stderr: Container roottestrestoreexternalengines-gw9-zoo3-1 Starting Stderr: Container roottestrestoreexternalengines-gw9-zoo1-1 Starting Stderr: Container roottestrestoreexternalengines-gw9-zoo1-1 Starting Stderr: Container roottestrestoreexternalengines-gw9-zoo2-1 Started Stderr: Container roottestrestoreexternalengines-gw9-zoo2-1 Started Stderr: Container roottestrestoreexternalengines-gw9-zoo1-1 Started Stderr: Container roottestrestoreexternalengines-gw9-zoo1-1 Started Stderr: Container roottestrestoreexternalengines-gw9-zoo3-1 Started Stderr: Container roottestrestoreexternalengines-gw9-zoo3-1 Started Stderr:time="2025-04-02T02:54:28Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:54:28Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:54:28Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:54:28Z" level=debug msg="otel error" error="" Wait ZooKeeper to start Wait ZooKeeper to start get_instance_ip instance_name=zoo1 get_instance_ip instance_name=zoo1 http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw9-zoo1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw9-zoo1-1/json HTTP/1.1" 200 None get_kazoo_client: zoo1, ip:172.16.1.4, port:2181, use_ssl:False get_kazoo_client: zoo1, ip:172.16.1.4, port:2181, use_ssl:False Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query SELECT * FROM `test_database_1`.`postgresql_replica_4` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database_1`.`postgresql_replica_4` LIMIT 1 FORMAT Null on instance Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB(10) PRIMARY KEY(key); DROP TABLE test; on node Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB(10) PRIMARY KEY(key); DROP TABLE test; on node Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query SHOW TABLES FROM `test_database_1` WHERE name = 'postgresql_replica_4' on instance Executing query SHOW TABLES FROM `test_database_1` WHERE name = 'postgresql_replica_4' on instance Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB(0, '/var/lib/clickhouse/store/test_rocksdb_read_only') PRIMARY KEY(key); DROP TABLE test; on node Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB(0, '/var/lib/clickhouse/store/test_rocksdb_read_only') PRIMARY KEY(key); DROP TABLE test; on node Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query select * from `postgres_database_1`.`postgresql_replica_4` order by key; on instance Executing query select * from `postgres_database_1`.`postgresql_replica_4` order by key; on instance Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB(10, '/var/lib/clickhouse/store/test_rocksdb_read_only', 1) PRIMARY KEY(key); DROP TABLE test; on node Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB(10, '/var/lib/clickhouse/store/test_rocksdb_read_only', 1) PRIMARY KEY(key); DROP TABLE test; on node Executing query select * from `test_database_1`.`postgresql_replica_4` order by key; on instance Executing query select * from `test_database_1`.`postgresql_replica_4` order by key; on instance [gw4] PASSED test_rocksdb_options/test.py::test_valid_options Command:[docker compose --env-file /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw4/.env --project-name roottestrocksdboptions-gw4 --file /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw4/node/docker-compose.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw4/.env --project-name roottestrocksdboptions-gw4 --file /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw4/node/docker-compose.yml stop --timeout 20] Executing query SELECT * FROM `test_database_2`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database_2`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Stderr: Container roottestrocksdboptions-gw4-node-1 Stopping Stderr: Container roottestrocksdboptions-gw4-node-1 Stopping Stderr: Container roottestrocksdboptions-gw4-node-1 Stopped Stderr: Container roottestrocksdboptions-gw4-node-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw4/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw4/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw4/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw4/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Executing query SHOW TABLES FROM `test_database_2` WHERE name = 'postgresql_replica_0' on instance Executing query SHOW TABLES FROM `test_database_2` WHERE name = 'postgresql_replica_0' on instance Command:[docker compose --env-file /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw4/.env --project-name roottestrocksdboptions-gw4 --file /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw4/node/docker-compose.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw4/.env --project-name roottestrocksdboptions-gw4 --file /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw4/node/docker-compose.yml down --volumes] Executing query select * from `postgres_database_2`.`postgresql_replica_0` order by key; on instance Executing query select * from `postgres_database_2`.`postgresql_replica_0` order by key; on instance Executing query select * from `test_database_2`.`postgresql_replica_0` order by key; on instance Executing query select * from `test_database_2`.`postgresql_replica_0` order by key; on instance Stderr: Container roottestrocksdboptions-gw4-node-1 Stopping Stderr: Container roottestrocksdboptions-gw4-node-1 Stopping Stderr: Container roottestrocksdboptions-gw4-node-1 Stopped Stderr: Container roottestrocksdboptions-gw4-node-1 Stopped Stderr: Container roottestrocksdboptions-gw4-node-1 Removing Stderr: Container roottestrocksdboptions-gw4-node-1 Removing Stderr: Container roottestrocksdboptions-gw4-node-1 Removed Stderr: Container roottestrocksdboptions-gw4-node-1 Removed Stderr: Network roottestrocksdboptions-gw4_default Removing Stderr: Network roottestrocksdboptions-gw4_default Removing Stderr: Network roottestrocksdboptions-gw4_default Removed Stderr: Network roottestrocksdboptions-gw4_default Removed Cleanup called Cleanup called Docker networks for project roottestrocksdboptions-gw4 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestrocksdboptions-gw4 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestrocksdboptions-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestrocksdboptions-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestrocksdboptions-gw4 are DRIVER VOLUME NAME Docker volumes for project roottestrocksdboptions-gw4 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestrocksdboptions-gw4-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestrocksdboptions-gw4-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestrocksdboptions-gw4 No running containers for project: roottestrocksdboptions-gw4 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Executing query select name, create_query from system.resources order by all on node Executing query select name, create_query from system.resources order by all on node Stdout:9 Stdout:9 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 9 Volumes pruned: 9 test_s3_imds/test_session_token.py::test_credentials_from_metadata Running tests in /ClickHouse/tests/integration/test_s3_imds/test_session_token.py Running tests in /ClickHouse/tests/integration/test_s3_imds/test_session_token.py Cluster start called. is_up=False Cluster start called. is_up=False Docker networks for project roottests3imdssessiontoken-gw4 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3imdssessiontoken-gw4 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3imdssessiontoken-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3imdssessiontoken-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Executing query SELECT * FROM `test_database_2`.`postgresql_replica_1` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database_2`.`postgresql_replica_1` LIMIT 1 FORMAT Null on instance Docker volumes for project roottests3imdssessiontoken-gw4 are DRIVER VOLUME NAME Docker volumes for project roottests3imdssessiontoken-gw4 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker networks for project roottests3imdssessiontoken-gw4 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3imdssessiontoken-gw4 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3imdssessiontoken-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3imdssessiontoken-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3imdssessiontoken-gw4 are DRIVER VOLUME NAME Docker volumes for project roottests3imdssessiontoken-gw4 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottests3imdssessiontoken-gw4-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottests3imdssessiontoken-gw4-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottests3imdssessiontoken-gw4 No running containers for project: roottests3imdssessiontoken-gw4 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:9 Stdout:9 Command:[docker volume prune -f] Command:[docker volume prune -f] Executing query select name, create_query from system.resources order by all on node2 Executing query select name, create_query from system.resources order by all on node2 Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 9 Volumes pruned: 9 Setup directory for instance: node Setup directory for instance: node Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_s3_imds/configs/use_environment_credentials.xml'] to /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/node/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_s3_imds/configs/use_environment_credentials.xml'] to /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/node/configs/config.d Setup database dir /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/node/database Setup database dir /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/node/database Setup logs dir /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/node/logs Setup logs dir /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/node/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'AWS_EC2_METADATA_SERVICE_ENDPOINT': 'resolver:8080', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'AWS_EC2_METADATA_SERVICE_ENDPOINT': 'resolver:8080', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/.env --project-name roottests3imdssessiontoken-gw4 --file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/.env --project-name roottests3imdssessiontoken-gw4 --file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml pull] Executing query SHOW TABLES FROM `test_database_2` WHERE name = 'postgresql_replica_1' on instance Executing query SHOW TABLES FROM `test_database_2` WHERE name = 'postgresql_replica_1' on instance Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node Executing query select * from `postgres_database_2`.`postgresql_replica_1` order by key; on instance Executing query select * from `postgres_database_2`.`postgresql_replica_1` order by key; on instance Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node2 Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node2 Executing query select * from `test_database_2`.`postgresql_replica_1` order by key; on instance Executing query select * from `test_database_2`.`postgresql_replica_1` order by key; on instance http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/6202ac13be51d5596b1ea25ef2b8ed94a0cd39b995d516fad0b04ac5ce573fb4/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/6202ac13be51d5596b1ea25ef2b8ed94a0cd39b995d516fad0b04ac5ce573fb4/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/exec/6202ac13be51d5596b1ea25ef2b8ed94a0cd39b995d516fad0b04ac5ce573fb4/json HTTP/1.1" 200 460 http://localhost:None "GET /v1.46/exec/6202ac13be51d5596b1ea25ef2b8ed94a0cd39b995d516fad0b04ac5ce573fb4/json HTTP/1.1" 200 460 [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-s', '172.16.8.9', '--dport', '2181', '-j', 'DROP'] (0): [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-s', '172.16.8.9', '--dport', '2181', '-j', 'DROP'] (0): http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/d1d1b21bc335eb1f75d19e26f159d05432219750c82ced96c37490e514c77afa/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/d1d1b21bc335eb1f75d19e26f159d05432219750c82ced96c37490e514c77afa/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/exec/d1d1b21bc335eb1f75d19e26f159d05432219750c82ced96c37490e514c77afa/json HTTP/1.1" 200 460 http://localhost:None "GET /v1.46/exec/d1d1b21bc335eb1f75d19e26f159d05432219750c82ced96c37490e514c77afa/json HTTP/1.1" 200 460 [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-d', '172.16.8.9', '--sport', '2181', '-j', 'DROP'] (0): [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-d', '172.16.8.9', '--sport', '2181', '-j', 'DROP'] (0): Executing query create workload B3 in Z settings priority = 1; on node Executing query create workload B3 in Z settings priority = 1; on node Executing query SELECT * FROM `test_database_2`.`postgresql_replica_2` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database_2`.`postgresql_replica_2` LIMIT 1 FORMAT Null on instance Executing query create workload C1 in X settings priority = -1; on node Executing query create workload C1 in X settings priority = -1; on node Executing query SHOW TABLES FROM `test_database_2` WHERE name = 'postgresql_replica_2' on instance Executing query SHOW TABLES FROM `test_database_2` WHERE name = 'postgresql_replica_2' on instance Executing query create workload C2 in X settings priority = -1; on node Executing query create workload C2 in X settings priority = -1; on node Executing query select * from `postgres_database_2`.`postgresql_replica_2` order by key; on instance Executing query select * from `postgres_database_2`.`postgresql_replica_2` order by key; on instance Executing query create workload C3 in X settings priority = -1; on node Executing query create workload C3 in X settings priority = -1; on node Executing query select * from `test_database_2`.`postgresql_replica_2` order by key; on instance Executing query select * from `test_database_2`.`postgresql_replica_2` order by key; on instance Executing query create workload D1 in X settings priority = 1; on node Executing query create workload D1 in X settings priority = 1; on node Executing query SELECT * FROM `test_database_2`.`postgresql_replica_3` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database_2`.`postgresql_replica_3` LIMIT 1 FORMAT Null on instance Executing query create workload D2 in X settings priority = 1; on node Executing query create workload D2 in X settings priority = 1; on node Executing query SHOW TABLES FROM `test_database_2` WHERE name = 'postgresql_replica_3' on instance Executing query SHOW TABLES FROM `test_database_2` WHERE name = 'postgresql_replica_3' on instance Executing query create workload D3 in X settings priority = 1; on node Executing query create workload D3 in X settings priority = 1; on node Executing query drop workload A1; on node Executing query drop workload A1; on node Executing query select * from `postgres_database_2`.`postgresql_replica_3` order by key; on instance Executing query select * from `postgres_database_2`.`postgresql_replica_3` order by key; on instance Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query drop workload B1; on node Executing query drop workload B1; on node Executing query select * from `test_database_2`.`postgresql_replica_3` order by key; on instance Executing query select * from `test_database_2`.`postgresql_replica_3` order by key; on instance Executing query drop workload C1; on node Executing query drop workload C1; on node Executing query SELECT * FROM `test_database_2`.`postgresql_replica_4` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database_2`.`postgresql_replica_4` LIMIT 1 FORMAT Null on instance Executing query drop workload D1; on node Executing query drop workload D1; on node Executing query SHOW TABLES FROM `test_database_2` WHERE name = 'postgresql_replica_4' on instance Executing query SHOW TABLES FROM `test_database_2` WHERE name = 'postgresql_replica_4' on instance http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/fc41668236a7f1c08b1641e2d78064a8fa1919d71231a341a5761bf7d9c80f93/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/fc41668236a7f1c08b1641e2d78064a8fa1919d71231a341a5761bf7d9c80f93/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/exec/fc41668236a7f1c08b1641e2d78064a8fa1919d71231a341a5761bf7d9c80f93/json HTTP/1.1" 200 456 http://localhost:None "GET /v1.46/exec/fc41668236a7f1c08b1641e2d78064a8fa1919d71231a341a5761bf7d9c80f93/json HTTP/1.1" 200 456 [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-d', '172.16.8.9', '--sport', '2181', '-j', 'DROP'] (0): [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-d', '172.16.8.9', '--sport', '2181', '-j', 'DROP'] (0): http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/778ac4200ab987c8514cd53427512e178514b7ce9159cd988ca9f23605f2957b/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/778ac4200ab987c8514cd53427512e178514b7ce9159cd988ca9f23605f2957b/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/exec/778ac4200ab987c8514cd53427512e178514b7ce9159cd988ca9f23605f2957b/json HTTP/1.1" 200 456 http://localhost:None "GET /v1.46/exec/778ac4200ab987c8514cd53427512e178514b7ce9159cd988ca9f23605f2957b/json HTTP/1.1" 200 456 [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-s', '172.16.8.9', '--dport', '2181', '-j', 'DROP'] (0): [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-s', '172.16.8.9', '--dport', '2181', '-j', 'DROP'] (0): Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node Executing query select * from `postgres_database_2`.`postgresql_replica_4` order by key; on instance Executing query select * from `postgres_database_2`.`postgresql_replica_4` order by key; on instance Executing query select * from `test_database_2`.`postgresql_replica_4` order by key; on instance Executing query select * from `test_database_2`.`postgresql_replica_4` order by key; on instance Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 Executing query DROP DATABASE IF EXISTS `test_database_2` SYNC on instance Executing query DROP DATABASE IF EXISTS `test_database_2` SYNC on instance [gw1] PASSED test_postgresql_replica_database_engine_1/test.py::test_multiple_databases Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node Executing query DROP DATABASE IF EXISTS `test_database_1` SYNC on instance Executing query DROP DATABASE IF EXISTS `test_database_1` SYNC on instance Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 Executing query DROP DATABASE IF EXISTS "postgres_database_2" on instance Executing query DROP DATABASE IF EXISTS "postgres_database_2" on instance Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Executing query DROP DATABASE IF EXISTS "postgres_database_1" on instance Executing query DROP DATABASE IF EXISTS "postgres_database_1" on instance Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo2 get_instance_ip instance_name=zoo2 http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw9-zoo2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw9-zoo2-1/json HTTP/1.1" 200 None get_kazoo_client: zoo2, ip:172.16.1.2, port:2181, use_ssl:False get_kazoo_client: zoo2, ip:172.16.1.2, port:2181, use_ssl:False Connecting to 172.16.1.2(172.16.1.2):2181, use_ssl: False Connecting to 172.16.1.2(172.16.1.2):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo3 get_instance_ip instance_name=zoo3 http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw9-zoo3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw9-zoo3-1/json HTTP/1.1" 200 None get_kazoo_client: zoo3, ip:172.16.1.3, port:2181, use_ssl:False get_kazoo_client: zoo3, ip:172.16.1.3, port:2181, use_ssl:False Connecting to 172.16.1.3(172.16.1.3):2181, use_ssl: False Connecting to 172.16.1.3(172.16.1.3):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') Setup MySQL 8 Setup MySQL 8 Command:[docker compose --project-name roottestrestoreexternalengines-gw9 --env-file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_mysql_8_0.yml --verbose up -d] Command:[docker compose --project-name roottestrestoreexternalengines-gw9 --env-file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_mysql_8_0.yml --verbose up -d] Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.resources order by all on node Executing query select name, create_query from system.resources order by all on node Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Stderr:time="2025-04-02T02:54:35Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:54:35Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:54:35Z" level=warning msg="Found orphan containers ([roottestrestoreexternalengines-gw9-zoo3-1 roottestrestoreexternalengines-gw9-zoo1-1 roottestrestoreexternalengines-gw9-zoo2-1]) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up." Stderr:time="2025-04-02T02:54:35Z" level=warning msg="Found orphan containers ([roottestrestoreexternalengines-gw9-zoo3-1 roottestrestoreexternalengines-gw9-zoo1-1 roottestrestoreexternalengines-gw9-zoo2-1]) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up." Stderr: Container roottestrestoreexternalengines-gw9-mysql80-1 Creating Stderr: Container roottestrestoreexternalengines-gw9-mysql80-1 Creating Stderr: Container roottestrestoreexternalengines-gw9-mysql80-1 Created Stderr: Container roottestrestoreexternalengines-gw9-mysql80-1 Created Stderr: Container roottestrestoreexternalengines-gw9-mysql80-1 Starting Stderr: Container roottestrestoreexternalengines-gw9-mysql80-1 Starting Stderr: Container roottestrestoreexternalengines-gw9-mysql80-1 Started Stderr: Container roottestrestoreexternalengines-gw9-mysql80-1 Started Stderr:time="2025-04-02T02:54:35Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:54:35Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:54:35Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:54:35Z" level=debug msg="otel error" error="" get_instance_ip instance_name=mysql80 get_instance_ip instance_name=mysql80 http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw9-mysql80-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw9-mysql80-1/json HTTP/1.1" 200 None Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.1.5' ([Errno 111] Connection refused)") Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.1.5' ([Errno 111] Connection refused)") Executing query select name, create_query from system.resources order by all on node2 Executing query select name, create_query from system.resources order by all on node2 Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance test_postgresql_replica_database_engine_1/test.py::test_quoting_1 Executing query INSERT INTO `postgres_database`.`user` SELECT number, number from numbers(50) on instance Executing query INSERT INTO `postgres_database`.`user` SELECT number, number from numbers(50) on instance Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.1.5' ([Errno 111] Connection refused)") Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.1.5' ([Errno 111] Connection refused)") Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node2 Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node2 Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/b6d8bce42fca4d2f6d62ce4455f2a861a6167d76cf098ad4cf6f14024f631a0d/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/b6d8bce42fca4d2f6d62ce4455f2a861a6167d76cf098ad4cf6f14024f631a0d/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/exec/b6d8bce42fca4d2f6d62ce4455f2a861a6167d76cf098ad4cf6f14024f631a0d/json HTTP/1.1" 200 460 http://localhost:None "GET /v1.46/exec/b6d8bce42fca4d2f6d62ce4455f2a861a6167d76cf098ad4cf6f14024f631a0d/json HTTP/1.1" 200 460 [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-s', '172.16.8.9', '--dport', '2181', '-j', 'DROP'] (0): [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-s', '172.16.8.9', '--dport', '2181', '-j', 'DROP'] (0): http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/f2466e4601c113e076b06138cb8e6f4243803474059161aee02e43850f0853ad/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/f2466e4601c113e076b06138cb8e6f4243803474059161aee02e43850f0853ad/start HTTP/1.1" 101 0 Executing query SHOW DATABASES on instance Executing query SHOW DATABASES on instance Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.1.5' ([Errno 111] Connection refused)") Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.1.5' ([Errno 111] Connection refused)") http://localhost:None "GET /v1.46/exec/f2466e4601c113e076b06138cb8e6f4243803474059161aee02e43850f0853ad/json HTTP/1.1" 200 460 http://localhost:None "GET /v1.46/exec/f2466e4601c113e076b06138cb8e6f4243803474059161aee02e43850f0853ad/json HTTP/1.1" 200 460 [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-d', '172.16.8.9', '--sport', '2181', '-j', 'DROP'] (0): [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-d', '172.16.8.9', '--sport', '2181', '-j', 'DROP'] (0): Executing query drop workload A2; on node Executing query drop workload A2; on node Executing query SELECT * FROM `test_database`.`user` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`user` LIMIT 1 FORMAT Null on instance Executing query drop workload B2; on node Executing query drop workload B2; on node Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.1.5' ([Errno 111] Connection refused)") Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.1.5' ([Errno 111] Connection refused)") Executing query drop workload C2; on node Executing query drop workload C2; on node Executing query SHOW TABLES FROM `test_database` WHERE name = 'user' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'user' on instance Executing query drop workload D2; on node Executing query drop workload D2; on node Executing query select * from `postgres_database`.`user` order by key; on instance Executing query select * from `postgres_database`.`user` order by key; on instance Executing query drop workload A3; on node Executing query drop workload A3; on node Executing query select * from `test_database`.`user` order by key; on instance Executing query select * from `test_database`.`user` order by key; on instance Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.1.5' ([Errno 111] Connection refused)") Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.1.5' ([Errno 111] Connection refused)") Executing query drop workload B3; on node Executing query drop workload B3; on node Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance [gw1] PASSED test_postgresql_replica_database_engine_1/test.py::test_quoting_1 Executing query drop workload C3; on node Executing query drop workload C3; on node Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query drop workload D3; on node Executing query drop workload D3; on node Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.1.5' ([Errno 111] Connection refused)") Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.1.5' ([Errno 111] Connection refused)") Executing query drop workload X; on node Executing query drop workload X; on node Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Stopped run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] No clickhouse process running. Start new one. No clickhouse process running. Start new one. http://localhost:None "POST /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-node2-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-node2-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/5f0c5d6f6b7c172b5cc61c12e13cf3239a491e5f91ab7e5ddb95e1c467155879/start HTTP/1.1" 200 0 http://localhost:None "POST /v1.46/exec/5f0c5d6f6b7c172b5cc61c12e13cf3239a491e5f91ab7e5ddb95e1c467155879/start HTTP/1.1" 200 0 http://localhost:None "GET /v1.46/exec/5f0c5d6f6b7c172b5cc61c12e13cf3239a491e5f91ab7e5ddb95e1c467155879/json HTTP/1.1" 200 586 http://localhost:None "GET /v1.46/exec/5f0c5d6f6b7c172b5cc61c12e13cf3239a491e5f91ab7e5ddb95e1c467155879/json HTTP/1.1" 200 586 Stderr: proxy1 Skipped - Image is already being pulled by proxy2 Stderr: proxy1 Skipped - Image is already being pulled by proxy2 Stderr: node Pulling Stderr: node Pulling Stderr: proxy2 Pulling Stderr: proxy2 Pulling Stderr: resolver Pulling Stderr: resolver Pulling Stderr: minio1 Pulling Stderr: minio1 Pulling Stderr: resolver Pulled Stderr: resolver Pulled Stderr: minio1 Pulled Stderr: minio1 Pulled Stderr: proxy2 Pulled Stderr: proxy2 Pulled Stderr: node Pulled Stderr: node Pulled Trying to create Minio instance by command docker compose --project-name roottests3imdssessiontoken-gw4 --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Trying to create Minio instance by command docker compose --project-name roottests3imdssessiontoken-gw4 --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Command:[docker compose --project-name roottests3imdssessiontoken-gw4 --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Command:[docker compose --project-name roottests3imdssessiontoken-gw4 --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Stderr: zoo3 Skipped - Image is already being pulled by zoo2 Stderr: zoo3 Skipped - Image is already being pulled by zoo2 Stderr: zoo1 Skipped - Image is already being pulled by zoo2 Stderr: zoo1 Skipped - Image is already being pulled by zoo2 Stderr: node Skipped - Image is already being pulled by zoo2 Stderr: node Skipped - Image is already being pulled by zoo2 Stderr: zoo2 Pulling Stderr: zoo2 Pulling Stderr: zoo2 Pulled Stderr: zoo2 Pulled Setup ZooKeeper Setup ZooKeeper Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/keeper1/log', '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/keeper1/config', '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/keeper1/coordination', '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/keeper2/log', '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/keeper2/config', '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/keeper2/coordination', '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/keeper3/log', '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/keeper3/config', '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/keeper3/coordination'] Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/keeper1/log', '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/keeper1/config', '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/keeper1/coordination', '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/keeper2/log', '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/keeper2/config', '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/keeper2/coordination', '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/keeper3/log', '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/keeper3/config', '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/keeper3/coordination'] Command:[docker compose --project-name roottestreloadauxiliaryzookeepers-gw0 --env-file /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Command:[docker compose --project-name roottestreloadauxiliaryzookeepers-gw0 --env-file /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Executing query drop workload Y; on node Executing query drop workload Y; on node Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.1.5' ([Errno 111] Connection refused)") Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.1.5' ([Errno 111] Connection refused)") Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: minio1 Pulling Stderr: minio1 Pulling Stderr: node Pulling Stderr: node Pulling Stderr: proxy1 Pulling Stderr: proxy1 Pulling Stderr: resolver Pulling Stderr: resolver Pulling Stderr: minio1 Pulled Stderr: minio1 Pulled Stderr: proxy1 Pulled Stderr: proxy1 Pulled Stderr: node Pulled Stderr: node Pulled Stderr: resolver Pulled Stderr: resolver Pulled Trying to create Minio instance by command docker compose --project-name roottests3storageconfproxy-gw6 --env-file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Trying to create Minio instance by command docker compose --project-name roottests3storageconfproxy-gw6 --env-file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Command:[docker compose --project-name roottests3storageconfproxy-gw6 --env-file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Command:[docker compose --project-name roottests3storageconfproxy-gw6 --env-file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] test_postgresql_replica_database_engine_1/test.py::test_quoting_2 Executing query INSERT INTO `postgres_database`.`user` SELECT number, number from numbers(50) on instance Executing query INSERT INTO `postgres_database`.`user` SELECT number, number from numbers(50) on instance Executing query drop workload Z; on node Executing query drop workload Z; on node Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query drop workload all; on node Executing query drop workload all; on node Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.1.5' ([Errno 111] Connection refused)") Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.1.5' ([Errno 111] Connection refused)") Stderr:time="2025-04-02T02:54:38Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:54:38Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottestreloadauxiliaryzookeepers-gw0_default Creating Stderr: Network roottestreloadauxiliaryzookeepers-gw0_default Creating Stderr: Network roottestreloadauxiliaryzookeepers-gw0_default Created Stderr: Network roottestreloadauxiliaryzookeepers-gw0_default Created Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo1-1 Creating Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo1-1 Creating Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo2-1 Creating Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo2-1 Creating Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo3-1 Creating Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo3-1 Creating Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo2-1 Created Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo2-1 Created Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo3-1 Created Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo3-1 Created Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo1-1 Created Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo1-1 Created Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo2-1 Starting Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo2-1 Starting Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo3-1 Starting Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo3-1 Starting Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo1-1 Starting Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo1-1 Starting Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo3-1 Started Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo3-1 Started Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo1-1 Started Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo1-1 Started Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo2-1 Started Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo2-1 Started Stderr:time="2025-04-02T02:54:39Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:54:39Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:54:39Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:54:39Z" level=debug msg="otel error" error="" Wait ZooKeeper to start Wait ZooKeeper to start get_instance_ip instance_name=zoo1 get_instance_ip instance_name=zoo1 http://localhost:None "GET /v1.46/containers/roottestreloadauxiliaryzookeepers-gw0-zoo1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadauxiliaryzookeepers-gw0-zoo1-1/json HTTP/1.1" 200 None get_kazoo_client: zoo1, ip:172.16.2.4, port:2181, use_ssl:False get_kazoo_client: zoo1, ip:172.16.2.4, port:2181, use_ssl:False Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/ee262f08e2305afc34d4bb69c15350dbc5f80ceb0c6431ace0e7700f626a8744/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/ee262f08e2305afc34d4bb69c15350dbc5f80ceb0c6431ace0e7700f626a8744/start HTTP/1.1" 101 0 Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') SETTINGS materialized_postgresql_tables_list = 'user' on instance Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') SETTINGS materialized_postgresql_tables_list = 'user' on instance http://localhost:None "GET /v1.46/exec/ee262f08e2305afc34d4bb69c15350dbc5f80ceb0c6431ace0e7700f626a8744/json HTTP/1.1" 200 456 http://localhost:None "GET /v1.46/exec/ee262f08e2305afc34d4bb69c15350dbc5f80ceb0c6431ace0e7700f626a8744/json HTTP/1.1" 200 456 [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-d', '172.16.8.9', '--sport', '2181', '-j', 'DROP'] (0): [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-d', '172.16.8.9', '--sport', '2181', '-j', 'DROP'] (0): http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/cc133aae63dff565f029ac8c826ce1516dd3e283c566b38d7f924b4a9942040b/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/cc133aae63dff565f029ac8c826ce1516dd3e283c566b38d7f924b4a9942040b/start HTTP/1.1" 101 0 run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Stdout:806 Stdout:806 Clickhouse process running. http://localhost:None "GET /v1.46/exec/cc133aae63dff565f029ac8c826ce1516dd3e283c566b38d7f924b4a9942040b/json HTTP/1.1" 200 456 http://localhost:None "GET /v1.46/exec/cc133aae63dff565f029ac8c826ce1516dd3e283c566b38d7f924b4a9942040b/json HTTP/1.1" 200 456 Clickhouse process running. run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-s', '172.16.8.9', '--dport', '2181', '-j', 'DROP'] (0): [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-s', '172.16.8.9', '--dport', '2181', '-j', 'DROP'] (0): Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node Stdout:806 Stdout:806 Executing query select 20 on node2 Executing query select 20 on node2 Executing query SHOW DATABASES on instance Executing query SHOW DATABASES on instance Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.1.5' ([Errno 111] Connection refused)") Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.1.5' ([Errno 111] Connection refused)") Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query SELECT * FROM `test_database`.`user` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`user` LIMIT 1 FORMAT Null on instance Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.1.5' ([Errno 111] Connection refused)") Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.1.5' ([Errno 111] Connection refused)") Stderr:time="2025-04-02T02:54:38Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:54:38Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottests3imdssessiontoken-gw4_default Creating Stderr: Network roottests3imdssessiontoken-gw4_default Creating Stderr: Network roottests3imdssessiontoken-gw4_default Created Stderr: Network roottests3imdssessiontoken-gw4_default Created Stderr: Volume "roottests3imdssessiontoken-gw4_data1-1" Creating Stderr: Volume "roottests3imdssessiontoken-gw4_data1-1" Creating Stderr: Volume "roottests3imdssessiontoken-gw4_data1-1" Created Stderr: Volume "roottests3imdssessiontoken-gw4_data1-1" Created Stderr: Container roottests3imdssessiontoken-gw4-proxy2-1 Creating Stderr: Container roottests3imdssessiontoken-gw4-proxy2-1 Creating Stderr: Container roottests3imdssessiontoken-gw4-proxy1-1 Creating Stderr: Container roottests3imdssessiontoken-gw4-proxy1-1 Creating Stderr: Container roottests3imdssessiontoken-gw4-proxy1-1 Created Stderr: Container roottests3imdssessiontoken-gw4-proxy1-1 Created Stderr: Container roottests3imdssessiontoken-gw4-proxy2-1 Created Stderr: Container roottests3imdssessiontoken-gw4-proxy2-1 Created Stderr: Container roottests3imdssessiontoken-gw4-minio1-1 Creating Stderr: Container roottests3imdssessiontoken-gw4-minio1-1 Creating Stderr: Container roottests3imdssessiontoken-gw4-resolver-1 Creating Stderr: Container roottests3imdssessiontoken-gw4-resolver-1 Creating Stderr: Container roottests3imdssessiontoken-gw4-resolver-1 Created Stderr: Container roottests3imdssessiontoken-gw4-resolver-1 Created Stderr: Container roottests3imdssessiontoken-gw4-minio1-1 Created Stderr: Container roottests3imdssessiontoken-gw4-minio1-1 Created Stderr: Container roottests3imdssessiontoken-gw4-proxy2-1 Starting Stderr: Container roottests3imdssessiontoken-gw4-proxy2-1 Starting Stderr: Container roottests3imdssessiontoken-gw4-proxy1-1 Starting Stderr: Container roottests3imdssessiontoken-gw4-proxy1-1 Starting Stderr: Container roottests3imdssessiontoken-gw4-proxy2-1 Started Stderr: Container roottests3imdssessiontoken-gw4-proxy2-1 Started Stderr: Container roottests3imdssessiontoken-gw4-proxy1-1 Started Stderr: Container roottests3imdssessiontoken-gw4-proxy1-1 Started Stderr: Container roottests3imdssessiontoken-gw4-minio1-1 Starting Stderr: Container roottests3imdssessiontoken-gw4-minio1-1 Starting Stderr: Container roottests3imdssessiontoken-gw4-resolver-1 Starting Stderr: Container roottests3imdssessiontoken-gw4-resolver-1 Starting Stderr: Container roottests3imdssessiontoken-gw4-resolver-1 Started Stderr: Container roottests3imdssessiontoken-gw4-resolver-1 Started Stderr: Container roottests3imdssessiontoken-gw4-minio1-1 Started Stderr: Container roottests3imdssessiontoken-gw4-minio1-1 Started Stderr:time="2025-04-02T02:54:39Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:54:39Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:54:39Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:54:39Z" level=debug msg="otel error" error="" Trying to connect to Minio... Trying to connect to Minio... get_instance_ip instance_name=minio1 get_instance_ip instance_name=minio1 http://localhost:None "GET /v1.46/containers/roottests3imdssessiontoken-gw4-minio1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3imdssessiontoken-gw4-minio1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=proxy1 get_instance_ip instance_name=proxy1 http://localhost:None "GET /v1.46/containers/roottests3imdssessiontoken-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3imdssessiontoken-gw4-proxy1-1/json HTTP/1.1" 200 None Starting new HTTP connection (1): 172.16.7.4:9001 Starting new HTTP connection (1): 172.16.7.4:9001 Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (2): 172.16.7.4:9001 Starting new HTTP connection (2): 172.16.7.4:9001 Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (3): 172.16.7.4:9001 Starting new HTTP connection (3): 172.16.7.4:9001 Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (4): 172.16.7.4:9001 Starting new HTTP connection (4): 172.16.7.4:9001 Can't connect to Minio: HTTPConnectionPool(host='172.16.7.4', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Can't connect to Minio: HTTPConnectionPool(host='172.16.7.4', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Executing query SHOW TABLES FROM `test_database` WHERE name = 'user' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'user' on instance Stderr:time="2025-04-02T02:54:38Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:54:38Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottests3storageconfproxy-gw6_default Creating Stderr: Network roottests3storageconfproxy-gw6_default Creating Stderr: Network roottests3storageconfproxy-gw6_default Created Stderr: Network roottests3storageconfproxy-gw6_default Created Stderr: Volume "roottests3storageconfproxy-gw6_data1-1" Creating Stderr: Volume "roottests3storageconfproxy-gw6_data1-1" Creating Stderr: Volume "roottests3storageconfproxy-gw6_data1-1" Created Stderr: Volume "roottests3storageconfproxy-gw6_data1-1" Created Stderr: Container roottests3storageconfproxy-gw6-proxy2-1 Creating Stderr: Container roottests3storageconfproxy-gw6-proxy2-1 Creating Stderr: Container roottests3storageconfproxy-gw6-proxy1-1 Creating Stderr: Container roottests3storageconfproxy-gw6-proxy1-1 Creating Stderr: Container roottests3storageconfproxy-gw6-proxy2-1 Created Stderr: Container roottests3storageconfproxy-gw6-proxy2-1 Created Stderr: Container roottests3storageconfproxy-gw6-proxy1-1 Created Stderr: Container roottests3storageconfproxy-gw6-proxy1-1 Created Stderr: Container roottests3storageconfproxy-gw6-resolver-1 Creating Stderr: Container roottests3storageconfproxy-gw6-resolver-1 Creating Stderr: Container roottests3storageconfproxy-gw6-minio1-1 Creating Stderr: Container roottests3storageconfproxy-gw6-minio1-1 Creating Stderr: Container roottests3storageconfproxy-gw6-minio1-1 Created Stderr: Container roottests3storageconfproxy-gw6-minio1-1 Created Stderr: Container roottests3storageconfproxy-gw6-resolver-1 Created Stderr: Container roottests3storageconfproxy-gw6-resolver-1 Created Stderr: Container roottests3storageconfproxy-gw6-proxy2-1 Starting Stderr: Container roottests3storageconfproxy-gw6-proxy2-1 Starting Stderr: Container roottests3storageconfproxy-gw6-proxy1-1 Starting Stderr: Container roottests3storageconfproxy-gw6-proxy1-1 Starting Stderr: Container roottests3storageconfproxy-gw6-proxy2-1 Started Stderr: Container roottests3storageconfproxy-gw6-proxy2-1 Started Stderr: Container roottests3storageconfproxy-gw6-proxy1-1 Started Stderr: Container roottests3storageconfproxy-gw6-proxy1-1 Started Stderr: Container roottests3storageconfproxy-gw6-resolver-1 Starting Stderr: Container roottests3storageconfproxy-gw6-resolver-1 Starting Stderr: Container roottests3storageconfproxy-gw6-minio1-1 Starting Stderr: Container roottests3storageconfproxy-gw6-minio1-1 Starting Stderr: Container roottests3storageconfproxy-gw6-resolver-1 Started Stderr: Container roottests3storageconfproxy-gw6-resolver-1 Started Stderr: Container roottests3storageconfproxy-gw6-minio1-1 Started Stderr: Container roottests3storageconfproxy-gw6-minio1-1 Started Stderr:time="2025-04-02T02:54:40Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:54:40Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:54:40Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:54:40Z" level=debug msg="otel error" error="" Trying to connect to Minio... Trying to connect to Minio... get_instance_ip instance_name=minio1 get_instance_ip instance_name=minio1 http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-minio1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-minio1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=proxy1 get_instance_ip instance_name=proxy1 http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None Starting new HTTP connection (1): 172.16.10.5:9001 Starting new HTTP connection (1): 172.16.10.5:9001 Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (2): 172.16.10.5:9001 Starting new HTTP connection (2): 172.16.10.5:9001 Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (3): 172.16.10.5:9001 Starting new HTTP connection (3): 172.16.10.5:9001 Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (4): 172.16.10.5:9001 Starting new HTTP connection (4): 172.16.10.5:9001 Can't connect to Minio: HTTPConnectionPool(host='172.16.10.5', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Can't connect to Minio: HTTPConnectionPool(host='172.16.10.5', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 Executing query select 20 on node2 Executing query select 20 on node2 Executing query select * from `postgres_database`.`user` order by key; on instance Executing query select * from `postgres_database`.`user` order by key; on instance Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query select name, create_query from system.resources order by all on node Executing query select name, create_query from system.resources order by all on node Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.1.5' ([Errno 111] Connection refused)") Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.1.5' ([Errno 111] Connection refused)") Executing query select * from `test_database`.`user` order by key; on instance Executing query select * from `test_database`.`user` order by key; on instance Executing query select name, create_query from system.resources order by all on node2 Executing query select name, create_query from system.resources order by all on node2 Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance [gw1] PASSED test_postgresql_replica_database_engine_1/test.py::test_quoting_2 Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node Executing query select 20 on node2 Executing query select 20 on node2 Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.1.5' ([Errno 111] Connection refused)") Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.1.5' ([Errno 111] Connection refused)") Starting new HTTP connection (5): 172.16.7.4:9001 Starting new HTTP connection (5): 172.16.7.4:9001 http://172.16.7.4:9001 "GET / HTTP/1.1" 200 0 http://172.16.7.4:9001 "GET / HTTP/1.1" 200 0 Connected to Minio. Connected to Minio. Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node2 Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node2 http://172.16.7.4:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.7.4:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.7.4:9001 "PUT /root HTTP/1.1" 200 0 http://172.16.7.4:9001 "PUT /root HTTP/1.1" 200 0 S3 bucket 'root' created S3 bucket 'root' created http://172.16.7.4:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.7.4:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.7.4:9001 "PUT /root2 HTTP/1.1" 200 0 http://172.16.7.4:9001 "PUT /root2 HTTP/1.1" 200 0 S3 bucket 'root2' created S3 bucket 'root2' created ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/.env --project-name roottests3imdssessiontoken-gw4 --file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/.env --project-name roottests3imdssessiontoken-gw4 --file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/.env --project-name roottests3imdssessiontoken-gw4 --file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/.env --project-name roottests3imdssessiontoken-gw4 --file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate] Starting new HTTP connection (5): 172.16.10.5:9001 Starting new HTTP connection (5): 172.16.10.5:9001 http://172.16.10.5:9001 "GET / HTTP/1.1" 200 0 http://172.16.10.5:9001 "GET / HTTP/1.1" 200 0 Connected to Minio. Connected to Minio. http://172.16.10.5:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.10.5:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.10.5:9001 "PUT /root HTTP/1.1" 200 0 http://172.16.10.5:9001 "PUT /root HTTP/1.1" 200 0 S3 bucket 'root' created S3 bucket 'root' created http://172.16.10.5:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.10.5:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.10.5:9001 "PUT /root2 HTTP/1.1" 200 0 http://172.16.10.5:9001 "PUT /root2 HTTP/1.1" 200 0 S3 bucket 'root2' created S3 bucket 'root2' created ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/.env --project-name roottests3storageconfproxy-gw6 --file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/.env --project-name roottests3storageconfproxy-gw6 --file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/.env --project-name roottests3storageconfproxy-gw6 --file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/.env --project-name roottests3storageconfproxy-gw6 --file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate] Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/a44603dee20ddd2155ca7e7fd5f82af2dbd1292131bd5553b02f2a4fa4d42221/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/a44603dee20ddd2155ca7e7fd5f82af2dbd1292131bd5553b02f2a4fa4d42221/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/exec/a44603dee20ddd2155ca7e7fd5f82af2dbd1292131bd5553b02f2a4fa4d42221/json HTTP/1.1" 200 460 http://localhost:None "GET /v1.46/exec/a44603dee20ddd2155ca7e7fd5f82af2dbd1292131bd5553b02f2a4fa4d42221/json HTTP/1.1" 200 460 [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-s', '172.16.8.9', '--dport', '2181', '-j', 'DROP'] (0): [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-s', '172.16.8.9', '--dport', '2181', '-j', 'DROP'] (0): http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/283038c700e4e07f81a5b6ab2812e2f4c7ea7684102613c4a9e6948c38d720c1/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/283038c700e4e07f81a5b6ab2812e2f4c7ea7684102613c4a9e6948c38d720c1/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/exec/283038c700e4e07f81a5b6ab2812e2f4c7ea7684102613c4a9e6948c38d720c1/json HTTP/1.1" 200 460 http://localhost:None "GET /v1.46/exec/283038c700e4e07f81a5b6ab2812e2f4c7ea7684102613c4a9e6948c38d720c1/json HTTP/1.1" 200 460 [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-d', '172.16.8.9', '--sport', '2181', '-j', 'DROP'] (0): [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-d', '172.16.8.9', '--sport', '2181', '-j', 'DROP'] (0): Executing query create workload all; on node Executing query create workload all; on node Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Stderr: Container roottests3imdssessiontoken-gw4-proxy2-1 Running Stderr: Container roottests3imdssessiontoken-gw4-proxy2-1 Running Stderr: Container roottests3imdssessiontoken-gw4-proxy1-1 Running Stderr: Container roottests3imdssessiontoken-gw4-proxy1-1 Running Stderr: Container roottests3imdssessiontoken-gw4-minio1-1 Running Stderr: Container roottests3imdssessiontoken-gw4-minio1-1 Running Stderr: Container roottests3imdssessiontoken-gw4-resolver-1 Running Stderr: Container roottests3imdssessiontoken-gw4-resolver-1 Running Stderr: Container roottests3imdssessiontoken-gw4-node-1 Creating Stderr: Container roottests3imdssessiontoken-gw4-node-1 Creating Stderr: Container roottests3imdssessiontoken-gw4-node-1 Created Stderr: Container roottests3imdssessiontoken-gw4-node-1 Created Stderr: Container roottests3imdssessiontoken-gw4-node-1 Starting Stderr: Container roottests3imdssessiontoken-gw4-node-1 Starting Stderr: Container roottests3imdssessiontoken-gw4-node-1 Started Stderr: Container roottests3imdssessiontoken-gw4-node-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottests3imdssessiontoken-gw4-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3imdssessiontoken-gw4-node-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottests3imdssessiontoken-gw4-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3imdssessiontoken-gw4-node-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node, ip: 172.16.7.6... Waiting for ClickHouse start in node, ip: 172.16.7.6... http://localhost:None "GET /v1.46/containers/roottests3imdssessiontoken-gw4-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3imdssessiontoken-gw4-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3e4dca055fb4fa4bba1339f6bc4443e81db342686db8ebfeb9e6740f8cab7cf1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3e4dca055fb4fa4bba1339f6bc4443e81db342686db8ebfeb9e6740f8cab7cf1/json HTTP/1.1" 200 None Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.1.5' ([Errno 111] Connection refused)") Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.1.5' ([Errno 111] Connection refused)") http://localhost:None "GET /v1.46/containers/3e4dca055fb4fa4bba1339f6bc4443e81db342686db8ebfeb9e6740f8cab7cf1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3e4dca055fb4fa4bba1339f6bc4443e81db342686db8ebfeb9e6740f8cab7cf1/json HTTP/1.1" 200 None http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 Executing query select 20 on node2 Executing query select 20 on node2 http://localhost:None "POST /v1.46/exec/50c75ccdc79d7eac964da87147196df7843eefe49e662df5113980ef3179cdbc/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/50c75ccdc79d7eac964da87147196df7843eefe49e662df5113980ef3179cdbc/start HTTP/1.1" 101 0 Stderr: Container roottests3storageconfproxy-gw6-proxy2-1 Running Stderr: Container roottests3storageconfproxy-gw6-proxy2-1 Running Stderr: Container roottests3storageconfproxy-gw6-proxy1-1 Running Stderr: Container roottests3storageconfproxy-gw6-proxy1-1 Running Stderr: Container roottests3storageconfproxy-gw6-minio1-1 Running Stderr: Container roottests3storageconfproxy-gw6-minio1-1 Running Stderr: Container roottests3storageconfproxy-gw6-node-1 Creating Stderr: Container roottests3storageconfproxy-gw6-node-1 Creating Stderr: Container roottests3storageconfproxy-gw6-resolver-1 Running Stderr: Container roottests3storageconfproxy-gw6-resolver-1 Running Stderr: Container roottests3storageconfproxy-gw6-node-1 Created Stderr: Container roottests3storageconfproxy-gw6-node-1 Created Stderr: Container roottests3storageconfproxy-gw6-node-1 Starting Stderr: Container roottests3storageconfproxy-gw6-node-1 Starting Stderr: Container roottests3storageconfproxy-gw6-node-1 Started Stderr: Container roottests3storageconfproxy-gw6-node-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-node-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-node-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node, ip: 172.16.10.6... Waiting for ClickHouse start in node, ip: 172.16.10.6... http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ee71a5f47ee0c48a3b79aa12c26d244cbff0e26e6f482075abc179163a87e814/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ee71a5f47ee0c48a3b79aa12c26d244cbff0e26e6f482075abc179163a87e814/json HTTP/1.1" 200 None Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/exec/50c75ccdc79d7eac964da87147196df7843eefe49e662df5113980ef3179cdbc/json HTTP/1.1" 200 456 http://localhost:None "GET /v1.46/exec/50c75ccdc79d7eac964da87147196df7843eefe49e662df5113980ef3179cdbc/json HTTP/1.1" 200 456 [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-d', '172.16.8.9', '--sport', '2181', '-j', 'DROP'] (0): [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-d', '172.16.8.9', '--sport', '2181', '-j', 'DROP'] (0): http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/448ae3c7a470b91ff40d97ce837a2347b1d7547a24ce67e568d609163b2c701d/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/448ae3c7a470b91ff40d97ce837a2347b1d7547a24ce67e568d609163b2c701d/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/containers/3e4dca055fb4fa4bba1339f6bc4443e81db342686db8ebfeb9e6740f8cab7cf1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3e4dca055fb4fa4bba1339f6bc4443e81db342686db8ebfeb9e6740f8cab7cf1/json HTTP/1.1" 200 None test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index Executing query INSERT INTO postgres_database.postgresql_replica SELECT number, number, number, number from numbers(50, 10) on instance Executing query INSERT INTO postgres_database.postgresql_replica SELECT number, number, number, number from numbers(50, 10) on instance http://localhost:None "GET /v1.46/containers/ee71a5f47ee0c48a3b79aa12c26d244cbff0e26e6f482075abc179163a87e814/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ee71a5f47ee0c48a3b79aa12c26d244cbff0e26e6f482075abc179163a87e814/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/exec/448ae3c7a470b91ff40d97ce837a2347b1d7547a24ce67e568d609163b2c701d/json HTTP/1.1" 200 456 http://localhost:None "GET /v1.46/exec/448ae3c7a470b91ff40d97ce837a2347b1d7547a24ce67e568d609163b2c701d/json HTTP/1.1" 200 456 [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-s', '172.16.8.9', '--dport', '2181', '-j', 'DROP'] (0): [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-s', '172.16.8.9', '--dport', '2181', '-j', 'DROP'] (0): Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node http://localhost:None "GET /v1.46/containers/3e4dca055fb4fa4bba1339f6bc4443e81db342686db8ebfeb9e6740f8cab7cf1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3e4dca055fb4fa4bba1339f6bc4443e81db342686db8ebfeb9e6740f8cab7cf1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ee71a5f47ee0c48a3b79aa12c26d244cbff0e26e6f482075abc179163a87e814/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ee71a5f47ee0c48a3b79aa12c26d244cbff0e26e6f482075abc179163a87e814/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3e4dca055fb4fa4bba1339f6bc4443e81db342686db8ebfeb9e6740f8cab7cf1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3e4dca055fb4fa4bba1339f6bc4443e81db342686db8ebfeb9e6740f8cab7cf1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ee71a5f47ee0c48a3b79aa12c26d244cbff0e26e6f482075abc179163a87e814/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ee71a5f47ee0c48a3b79aa12c26d244cbff0e26e6f482075abc179163a87e814/json HTTP/1.1" 200 None Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 http://localhost:None "GET /v1.46/containers/3e4dca055fb4fa4bba1339f6bc4443e81db342686db8ebfeb9e6740f8cab7cf1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3e4dca055fb4fa4bba1339f6bc4443e81db342686db8ebfeb9e6740f8cab7cf1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ee71a5f47ee0c48a3b79aa12c26d244cbff0e26e6f482075abc179163a87e814/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ee71a5f47ee0c48a3b79aa12c26d244cbff0e26e6f482075abc179163a87e814/json HTTP/1.1" 200 None Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.1.5' ([Errno 111] Connection refused)") Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.1.5' ([Errno 111] Connection refused)") Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance http://localhost:None "GET /v1.46/containers/3e4dca055fb4fa4bba1339f6bc4443e81db342686db8ebfeb9e6740f8cab7cf1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3e4dca055fb4fa4bba1339f6bc4443e81db342686db8ebfeb9e6740f8cab7cf1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ee71a5f47ee0c48a3b79aa12c26d244cbff0e26e6f482075abc179163a87e814/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ee71a5f47ee0c48a3b79aa12c26d244cbff0e26e6f482075abc179163a87e814/json HTTP/1.1" 200 None Executing query select name, create_query from system.resources order by all on node Executing query select name, create_query from system.resources order by all on node http://localhost:None "GET /v1.46/containers/3e4dca055fb4fa4bba1339f6bc4443e81db342686db8ebfeb9e6740f8cab7cf1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3e4dca055fb4fa4bba1339f6bc4443e81db342686db8ebfeb9e6740f8cab7cf1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ee71a5f47ee0c48a3b79aa12c26d244cbff0e26e6f482075abc179163a87e814/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ee71a5f47ee0c48a3b79aa12c26d244cbff0e26e6f482075abc179163a87e814/json HTTP/1.1" 200 None Executing query SHOW DATABASES on instance Executing query SHOW DATABASES on instance Executing query select 20 on node2 Executing query select 20 on node2 http://localhost:None "GET /v1.46/containers/3e4dca055fb4fa4bba1339f6bc4443e81db342686db8ebfeb9e6740f8cab7cf1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3e4dca055fb4fa4bba1339f6bc4443e81db342686db8ebfeb9e6740f8cab7cf1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ee71a5f47ee0c48a3b79aa12c26d244cbff0e26e6f482075abc179163a87e814/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ee71a5f47ee0c48a3b79aa12c26d244cbff0e26e6f482075abc179163a87e814/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3e4dca055fb4fa4bba1339f6bc4443e81db342686db8ebfeb9e6740f8cab7cf1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3e4dca055fb4fa4bba1339f6bc4443e81db342686db8ebfeb9e6740f8cab7cf1/json HTTP/1.1" 200 None Executing query select name, create_query from system.resources order by all on node2 Executing query select name, create_query from system.resources order by all on node2 http://localhost:None "GET /v1.46/containers/ee71a5f47ee0c48a3b79aa12c26d244cbff0e26e6f482075abc179163a87e814/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ee71a5f47ee0c48a3b79aa12c26d244cbff0e26e6f482075abc179163a87e814/json HTTP/1.1" 200 None Executing query INSERT INTO postgres_database.postgresql_replica SELECT number, number, number, number from numbers(100, 10) on instance Executing query INSERT INTO postgres_database.postgresql_replica SELECT number, number, number, number from numbers(100, 10) on instance http://localhost:None "GET /v1.46/containers/3e4dca055fb4fa4bba1339f6bc4443e81db342686db8ebfeb9e6740f8cab7cf1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3e4dca055fb4fa4bba1339f6bc4443e81db342686db8ebfeb9e6740f8cab7cf1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ee71a5f47ee0c48a3b79aa12c26d244cbff0e26e6f482075abc179163a87e814/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ee71a5f47ee0c48a3b79aa12c26d244cbff0e26e6f482075abc179163a87e814/json HTTP/1.1" 200 None Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.1.5' ([Errno 111] Connection refused)") Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.1.5' ([Errno 111] Connection refused)") http://localhost:None "GET /v1.46/containers/3e4dca055fb4fa4bba1339f6bc4443e81db342686db8ebfeb9e6740f8cab7cf1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3e4dca055fb4fa4bba1339f6bc4443e81db342686db8ebfeb9e6740f8cab7cf1/json HTTP/1.1" 200 None Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node http://localhost:None "GET /v1.46/containers/ee71a5f47ee0c48a3b79aa12c26d244cbff0e26e6f482075abc179163a87e814/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ee71a5f47ee0c48a3b79aa12c26d244cbff0e26e6f482075abc179163a87e814/json HTTP/1.1" 200 None Executing query SELECT * FROM `test_database`.`postgresql_replica` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica` LIMIT 1 FORMAT Null on instance http://localhost:None "GET /v1.46/containers/3e4dca055fb4fa4bba1339f6bc4443e81db342686db8ebfeb9e6740f8cab7cf1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3e4dca055fb4fa4bba1339f6bc4443e81db342686db8ebfeb9e6740f8cab7cf1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ee71a5f47ee0c48a3b79aa12c26d244cbff0e26e6f482075abc179163a87e814/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ee71a5f47ee0c48a3b79aa12c26d244cbff0e26e6f482075abc179163a87e814/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3e4dca055fb4fa4bba1339f6bc4443e81db342686db8ebfeb9e6740f8cab7cf1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3e4dca055fb4fa4bba1339f6bc4443e81db342686db8ebfeb9e6740f8cab7cf1/json HTTP/1.1" 200 None ClickHouse node started ClickHouse node started Starting mock server server_with_session_tokens.py Starting mock server server_with_session_tokens.py run container_id:roottests3imdssessiontoken-gw4-resolver-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname server_with_session_tokens.py) && echo aW1wb3J0IGh0dHAuc2VydmVyCmltcG9ydCBzeXMKaW1wb3J0IHV1aWQKCiMgU2Vzc2lvbiB0b2tlbnMgZm9yIElNRFMgc2Vzc2lvbnMuCnRva2VucyA9IHNldCgpCgoKZGVmIG5ld190b2tlbigpOgogICAgdG9rZW4gPSBzdHIodXVpZC51dWlkNCgpKQogICAgZ2xvYmFsIHRva2VucwogICAgdG9rZW5zLmFkZCh0b2tlbikKICAgIHJldHVybiB0b2tlbgoKCmRlZiB0b2tlbl9leGlzdHModG9rZW4pOgogICAgZ2xvYmFsIHRva2VucwogICAgcmV0dXJuIHRva2VuIGluIHRva2VucwoKCmNsYXNzIFJlcXVlc3RIYW5kbGVyKGh0dHAuc2VydmVyLkJhc2VIVFRQUmVxdWVzdEhhbmRsZXIpOgogICAgZGVmIGdldF9yZXNwb25zZShzZWxmKToKICAgICAgICBpZiBzZWxmLnBhdGggPT0gIi8iOgogICAgICAgICAgICByZXR1cm4gIk9LIiwgMjAwCgogICAgICAgIGlmIHNlbGYucGF0aCA9PSAiL2xhdGVzdC9hcGkvdG9rZW4iOgogICAgICAgICAgICByZXR1cm4gbmV3X3Rva2VuKCksIDIwMAoKICAgICAgICBpZiBzZWxmLnBhdGggPT0gIi9sYXRlc3QvbWV0YS1kYXRhL2lhbS9zZWN1cml0eS1jcmVkZW50aWFscyI6CiAgICAgICAgICAgIGlmIHRva2VuX2V4aXN0cyhzZWxmLmhlYWRlcnMuZ2V0KCJ4LWF3cy1lYzItbWV0YWRhdGEtdG9rZW4iKSk6CiAgICAgICAgICAgICAgICByZXR1cm4gIm15cm9sZSIsIDIwMAoKICAgICAgICBpZiBzZWxmLnBhdGggPT0gIi9sYXRlc3QvbWV0YS1kYXRhL2lhbS9zZWN1cml0eS1jcmVkZW50aWFscy9teXJvbGUiOgogICAgICAgICAgICBpZiB0b2tlbl9leGlzdHMoc2VsZi5oZWFkZXJzLmdldCgieC1hd3MtZWMyLW1ldGFkYXRhLXRva2VuIikpOgogICAgICAgICAgICAgICAgcmV0dXJuICgKICAgICAgICAgICAgICAgICAgICAneyAiQ29kZSIgOiAiU3VjY2VzcyIsICJUeXBlIiA6ICJBV1MtSE1BQyIsICJBY2Nlc3NLZXlJZCIgOiAibWluaW8iLCAiU2VjcmV0QWNjZXNzS2V5IiA6ICJtaW5pbzEyMyIgfScsCiAgICAgICAgICAgICAgICAgICAgMjAwLAogICAgICAgICAgICAgICAgKQoKICAgICAgICBpZiBzZWxmLnBhdGguc3RhcnRzd2l0aCgiL2xhdGVzdC9tZXRhLWRhdGEvaWFtL3NlY3VyaXR5LWNyZWRlbnRpYWxzIik6CiAgICAgICAgICAgIHJldHVybiAiIiwgNDAxICAjIFVua25vd24gdG9rZW4gb3Igbm90IHNwZWNpZmllZC4KCiAgICAgICAgIyBSZXNvdXJjZSBub3QgZm91bmQuCiAgICAgICAgcmV0dXJuICIiLCA0MDQKCiAgICBkZWYgZG9fSEVBRChzZWxmKToKICAgICAgICByZXNwb25zZSwgY29kZSA9IHNlbGYuZ2V0X3Jlc3BvbnNlKCkKICAgICAgICBzZWxmLnNlbmRfcmVzcG9uc2UoY29kZSkKICAgICAgICBzZWxmLnNlbmRfaGVhZGVyKCJDb250ZW50LVR5cGUiLCAidGV4dC9wbGFpbiIpCiAgICAgICAgc2VsZi5zZW5kX2hlYWRlcigiQ29udGVudC1MZW5ndGgiLCBsZW4ocmVzcG9uc2UuZW5jb2RlKCkpKQogICAgICAgIHNlbGYuZW5kX2hlYWRlcnMoKQogICAgICAgIHJldHVybiByZXNwb25zZSwgY29kZQoKICAgIGRlZiBkb19HRVQoc2VsZik6CiAgICAgICAgcmVzcG9uc2UsIF8gPSBzZWxmLmRvX0hFQUQoKQogICAgICAgIHNlbGYud2ZpbGUud3JpdGUocmVzcG9uc2UuZW5jb2RlKCkpCgogICAgZGVmIGRvX1BVVChzZWxmKToKICAgICAgICBzZWxmLmRvX0dFVCgpCgoKaHR0cGQgPSBodHRwLnNlcnZlci5IVFRQU2VydmVyKCgiMC4wLjAuMCIsIGludChzeXMuYXJndlsxXSkpLCBSZXF1ZXN0SGFuZGxlcikKaHR0cGQuc2VydmVfZm9yZXZlcigpCg== | base64 --decode > server_with_session_tokens.py'] run container_id:roottests3imdssessiontoken-gw4-resolver-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname server_with_session_tokens.py) && echo aW1wb3J0IGh0dHAuc2VydmVyCmltcG9ydCBzeXMKaW1wb3J0IHV1aWQKCiMgU2Vzc2lvbiB0b2tlbnMgZm9yIElNRFMgc2Vzc2lvbnMuCnRva2VucyA9IHNldCgpCgoKZGVmIG5ld190b2tlbigpOgogICAgdG9rZW4gPSBzdHIodXVpZC51dWlkNCgpKQogICAgZ2xvYmFsIHRva2VucwogICAgdG9rZW5zLmFkZCh0b2tlbikKICAgIHJldHVybiB0b2tlbgoKCmRlZiB0b2tlbl9leGlzdHModG9rZW4pOgogICAgZ2xvYmFsIHRva2VucwogICAgcmV0dXJuIHRva2VuIGluIHRva2VucwoKCmNsYXNzIFJlcXVlc3RIYW5kbGVyKGh0dHAuc2VydmVyLkJhc2VIVFRQUmVxdWVzdEhhbmRsZXIpOgogICAgZGVmIGdldF9yZXNwb25zZShzZWxmKToKICAgICAgICBpZiBzZWxmLnBhdGggPT0gIi8iOgogICAgICAgICAgICByZXR1cm4gIk9LIiwgMjAwCgogICAgICAgIGlmIHNlbGYucGF0aCA9PSAiL2xhdGVzdC9hcGkvdG9rZW4iOgogICAgICAgICAgICByZXR1cm4gbmV3X3Rva2VuKCksIDIwMAoKICAgICAgICBpZiBzZWxmLnBhdGggPT0gIi9sYXRlc3QvbWV0YS1kYXRhL2lhbS9zZWN1cml0eS1jcmVkZW50aWFscyI6CiAgICAgICAgICAgIGlmIHRva2VuX2V4aXN0cyhzZWxmLmhlYWRlcnMuZ2V0KCJ4LWF3cy1lYzItbWV0YWRhdGEtdG9rZW4iKSk6CiAgICAgICAgICAgICAgICByZXR1cm4gIm15cm9sZSIsIDIwMAoKICAgICAgICBpZiBzZWxmLnBhdGggPT0gIi9sYXRlc3QvbWV0YS1kYXRhL2lhbS9zZWN1cml0eS1jcmVkZW50aWFscy9teXJvbGUiOgogICAgICAgICAgICBpZiB0b2tlbl9leGlzdHMoc2VsZi5oZWFkZXJzLmdldCgieC1hd3MtZWMyLW1ldGFkYXRhLXRva2VuIikpOgogICAgICAgICAgICAgICAgcmV0dXJuICgKICAgICAgICAgICAgICAgICAgICAneyAiQ29kZSIgOiAiU3VjY2VzcyIsICJUeXBlIiA6ICJBV1MtSE1BQyIsICJBY2Nlc3NLZXlJZCIgOiAibWluaW8iLCAiU2VjcmV0QWNjZXNzS2V5IiA6ICJtaW5pbzEyMyIgfScsCiAgICAgICAgICAgICAgICAgICAgMjAwLAogICAgICAgICAgICAgICAgKQoKICAgICAgICBpZiBzZWxmLnBhdGguc3RhcnRzd2l0aCgiL2xhdGVzdC9tZXRhLWRhdGEvaWFtL3NlY3VyaXR5LWNyZWRlbnRpYWxzIik6CiAgICAgICAgICAgIHJldHVybiAiIiwgNDAxICAjIFVua25vd24gdG9rZW4gb3Igbm90IHNwZWNpZmllZC4KCiAgICAgICAgIyBSZXNvdXJjZSBub3QgZm91bmQuCiAgICAgICAgcmV0dXJuICIiLCA0MDQKCiAgICBkZWYgZG9fSEVBRChzZWxmKToKICAgICAgICByZXNwb25zZSwgY29kZSA9IHNlbGYuZ2V0X3Jlc3BvbnNlKCkKICAgICAgICBzZWxmLnNlbmRfcmVzcG9uc2UoY29kZSkKICAgICAgICBzZWxmLnNlbmRfaGVhZGVyKCJDb250ZW50LVR5cGUiLCAidGV4dC9wbGFpbiIpCiAgICAgICAgc2VsZi5zZW5kX2hlYWRlcigiQ29udGVudC1MZW5ndGgiLCBsZW4ocmVzcG9uc2UuZW5jb2RlKCkpKQogICAgICAgIHNlbGYuZW5kX2hlYWRlcnMoKQogICAgICAgIHJldHVybiByZXNwb25zZSwgY29kZQoKICAgIGRlZiBkb19HRVQoc2VsZik6CiAgICAgICAgcmVzcG9uc2UsIF8gPSBzZWxmLmRvX0hFQUQoKQogICAgICAgIHNlbGYud2ZpbGUud3JpdGUocmVzcG9uc2UuZW5jb2RlKCkpCgogICAgZGVmIGRvX1BVVChzZWxmKToKICAgICAgICBzZWxmLmRvX0dFVCgpCgoKaHR0cGQgPSBodHRwLnNlcnZlci5IVFRQU2VydmVyKCgiMC4wLjAuMCIsIGludChzeXMuYXJndlsxXSkpLCBSZXF1ZXN0SGFuZGxlcikKaHR0cGQuc2VydmVfZm9yZXZlcigpCg== | base64 --decode > server_with_session_tokens.py'] Command:[docker exec roottests3imdssessiontoken-gw4-resolver-1 bash -c mkdir -p $(dirname server_with_session_tokens.py) && echo aW1wb3J0IGh0dHAuc2VydmVyCmltcG9ydCBzeXMKaW1wb3J0IHV1aWQKCiMgU2Vzc2lvbiB0b2tlbnMgZm9yIElNRFMgc2Vzc2lvbnMuCnRva2VucyA9IHNldCgpCgoKZGVmIG5ld190b2tlbigpOgogICAgdG9rZW4gPSBzdHIodXVpZC51dWlkNCgpKQogICAgZ2xvYmFsIHRva2VucwogICAgdG9rZW5zLmFkZCh0b2tlbikKICAgIHJldHVybiB0b2tlbgoKCmRlZiB0b2tlbl9leGlzdHModG9rZW4pOgogICAgZ2xvYmFsIHRva2VucwogICAgcmV0dXJuIHRva2VuIGluIHRva2VucwoKCmNsYXNzIFJlcXVlc3RIYW5kbGVyKGh0dHAuc2VydmVyLkJhc2VIVFRQUmVxdWVzdEhhbmRsZXIpOgogICAgZGVmIGdldF9yZXNwb25zZShzZWxmKToKICAgICAgICBpZiBzZWxmLnBhdGggPT0gIi8iOgogICAgICAgICAgICByZXR1cm4gIk9LIiwgMjAwCgogICAgICAgIGlmIHNlbGYucGF0aCA9PSAiL2xhdGVzdC9hcGkvdG9rZW4iOgogICAgICAgICAgICByZXR1cm4gbmV3X3Rva2VuKCksIDIwMAoKICAgICAgICBpZiBzZWxmLnBhdGggPT0gIi9sYXRlc3QvbWV0YS1kYXRhL2lhbS9zZWN1cml0eS1jcmVkZW50aWFscyI6CiAgICAgICAgICAgIGlmIHRva2VuX2V4aXN0cyhzZWxmLmhlYWRlcnMuZ2V0KCJ4LWF3cy1lYzItbWV0YWRhdGEtdG9rZW4iKSk6CiAgICAgICAgICAgICAgICByZXR1cm4gIm15cm9sZSIsIDIwMAoKICAgICAgICBpZiBzZWxmLnBhdGggPT0gIi9sYXRlc3QvbWV0YS1kYXRhL2lhbS9zZWN1cml0eS1jcmVkZW50aWFscy9teXJvbGUiOgogICAgICAgICAgICBpZiB0b2tlbl9leGlzdHMoc2VsZi5oZWFkZXJzLmdldCgieC1hd3MtZWMyLW1ldGFkYXRhLXRva2VuIikpOgogICAgICAgICAgICAgICAgcmV0dXJuICgKICAgICAgICAgICAgICAgICAgICAneyAiQ29kZSIgOiAiU3VjY2VzcyIsICJUeXBlIiA6ICJBV1MtSE1BQyIsICJBY2Nlc3NLZXlJZCIgOiAibWluaW8iLCAiU2VjcmV0QWNjZXNzS2V5IiA6ICJtaW5pbzEyMyIgfScsCiAgICAgICAgICAgICAgICAgICAgMjAwLAogICAgICAgICAgICAgICAgKQoKICAgICAgICBpZiBzZWxmLnBhdGguc3RhcnRzd2l0aCgiL2xhdGVzdC9tZXRhLWRhdGEvaWFtL3NlY3VyaXR5LWNyZWRlbnRpYWxzIik6CiAgICAgICAgICAgIHJldHVybiAiIiwgNDAxICAjIFVua25vd24gdG9rZW4gb3Igbm90IHNwZWNpZmllZC4KCiAgICAgICAgIyBSZXNvdXJjZSBub3QgZm91bmQuCiAgICAgICAgcmV0dXJuICIiLCA0MDQKCiAgICBkZWYgZG9fSEVBRChzZWxmKToKICAgICAgICByZXNwb25zZSwgY29kZSA9IHNlbGYuZ2V0X3Jlc3BvbnNlKCkKICAgICAgICBzZWxmLnNlbmRfcmVzcG9uc2UoY29kZSkKICAgICAgICBzZWxmLnNlbmRfaGVhZGVyKCJDb250ZW50LVR5cGUiLCAidGV4dC9wbGFpbiIpCiAgICAgICAgc2VsZi5zZW5kX2hlYWRlcigiQ29udGVudC1MZW5ndGgiLCBsZW4ocmVzcG9uc2UuZW5jb2RlKCkpKQogICAgICAgIHNlbGYuZW5kX2hlYWRlcnMoKQogICAgICAgIHJldHVybiByZXNwb25zZSwgY29kZQoKICAgIGRlZiBkb19HRVQoc2VsZik6CiAgICAgICAgcmVzcG9uc2UsIF8gPSBzZWxmLmRvX0hFQUQoKQogICAgICAgIHNlbGYud2ZpbGUud3JpdGUocmVzcG9uc2UuZW5jb2RlKCkpCgogICAgZGVmIGRvX1BVVChzZWxmKToKICAgICAgICBzZWxmLmRvX0dFVCgpCgoKaHR0cGQgPSBodHRwLnNlcnZlci5IVFRQU2VydmVyKCgiMC4wLjAuMCIsIGludChzeXMuYXJndlsxXSkpLCBSZXF1ZXN0SGFuZGxlcikKaHR0cGQuc2VydmVfZm9yZXZlcigpCg== | base64 --decode > server_with_session_tokens.py] Command:[docker exec roottests3imdssessiontoken-gw4-resolver-1 bash -c mkdir -p $(dirname server_with_session_tokens.py) && echo aW1wb3J0IGh0dHAuc2VydmVyCmltcG9ydCBzeXMKaW1wb3J0IHV1aWQKCiMgU2Vzc2lvbiB0b2tlbnMgZm9yIElNRFMgc2Vzc2lvbnMuCnRva2VucyA9IHNldCgpCgoKZGVmIG5ld190b2tlbigpOgogICAgdG9rZW4gPSBzdHIodXVpZC51dWlkNCgpKQogICAgZ2xvYmFsIHRva2VucwogICAgdG9rZW5zLmFkZCh0b2tlbikKICAgIHJldHVybiB0b2tlbgoKCmRlZiB0b2tlbl9leGlzdHModG9rZW4pOgogICAgZ2xvYmFsIHRva2VucwogICAgcmV0dXJuIHRva2VuIGluIHRva2VucwoKCmNsYXNzIFJlcXVlc3RIYW5kbGVyKGh0dHAuc2VydmVyLkJhc2VIVFRQUmVxdWVzdEhhbmRsZXIpOgogICAgZGVmIGdldF9yZXNwb25zZShzZWxmKToKICAgICAgICBpZiBzZWxmLnBhdGggPT0gIi8iOgogICAgICAgICAgICByZXR1cm4gIk9LIiwgMjAwCgogICAgICAgIGlmIHNlbGYucGF0aCA9PSAiL2xhdGVzdC9hcGkvdG9rZW4iOgogICAgICAgICAgICByZXR1cm4gbmV3X3Rva2VuKCksIDIwMAoKICAgICAgICBpZiBzZWxmLnBhdGggPT0gIi9sYXRlc3QvbWV0YS1kYXRhL2lhbS9zZWN1cml0eS1jcmVkZW50aWFscyI6CiAgICAgICAgICAgIGlmIHRva2VuX2V4aXN0cyhzZWxmLmhlYWRlcnMuZ2V0KCJ4LWF3cy1lYzItbWV0YWRhdGEtdG9rZW4iKSk6CiAgICAgICAgICAgICAgICByZXR1cm4gIm15cm9sZSIsIDIwMAoKICAgICAgICBpZiBzZWxmLnBhdGggPT0gIi9sYXRlc3QvbWV0YS1kYXRhL2lhbS9zZWN1cml0eS1jcmVkZW50aWFscy9teXJvbGUiOgogICAgICAgICAgICBpZiB0b2tlbl9leGlzdHMoc2VsZi5oZWFkZXJzLmdldCgieC1hd3MtZWMyLW1ldGFkYXRhLXRva2VuIikpOgogICAgICAgICAgICAgICAgcmV0dXJuICgKICAgICAgICAgICAgICAgICAgICAneyAiQ29kZSIgOiAiU3VjY2VzcyIsICJUeXBlIiA6ICJBV1MtSE1BQyIsICJBY2Nlc3NLZXlJZCIgOiAibWluaW8iLCAiU2VjcmV0QWNjZXNzS2V5IiA6ICJtaW5pbzEyMyIgfScsCiAgICAgICAgICAgICAgICAgICAgMjAwLAogICAgICAgICAgICAgICAgKQoKICAgICAgICBpZiBzZWxmLnBhdGguc3RhcnRzd2l0aCgiL2xhdGVzdC9tZXRhLWRhdGEvaWFtL3NlY3VyaXR5LWNyZWRlbnRpYWxzIik6CiAgICAgICAgICAgIHJldHVybiAiIiwgNDAxICAjIFVua25vd24gdG9rZW4gb3Igbm90IHNwZWNpZmllZC4KCiAgICAgICAgIyBSZXNvdXJjZSBub3QgZm91bmQuCiAgICAgICAgcmV0dXJuICIiLCA0MDQKCiAgICBkZWYgZG9fSEVBRChzZWxmKToKICAgICAgICByZXNwb25zZSwgY29kZSA9IHNlbGYuZ2V0X3Jlc3BvbnNlKCkKICAgICAgICBzZWxmLnNlbmRfcmVzcG9uc2UoY29kZSkKICAgICAgICBzZWxmLnNlbmRfaGVhZGVyKCJDb250ZW50LVR5cGUiLCAidGV4dC9wbGFpbiIpCiAgICAgICAgc2VsZi5zZW5kX2hlYWRlcigiQ29udGVudC1MZW5ndGgiLCBsZW4ocmVzcG9uc2UuZW5jb2RlKCkpKQogICAgICAgIHNlbGYuZW5kX2hlYWRlcnMoKQogICAgICAgIHJldHVybiByZXNwb25zZSwgY29kZQoKICAgIGRlZiBkb19HRVQoc2VsZik6CiAgICAgICAgcmVzcG9uc2UsIF8gPSBzZWxmLmRvX0hFQUQoKQogICAgICAgIHNlbGYud2ZpbGUud3JpdGUocmVzcG9uc2UuZW5jb2RlKCkpCgogICAgZGVmIGRvX1BVVChzZWxmKToKICAgICAgICBzZWxmLmRvX0dFVCgpCgoKaHR0cGQgPSBodHRwLnNlcnZlci5IVFRQU2VydmVyKCgiMC4wLjAuMCIsIGludChzeXMuYXJndlsxXSkpLCBSZXF1ZXN0SGFuZGxlcikKaHR0cGQuc2VydmVfZm9yZXZlcigpCg== | base64 --decode > server_with_session_tokens.py] Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node2 Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node2 http://localhost:None "GET /v1.46/containers/ee71a5f47ee0c48a3b79aa12c26d244cbff0e26e6f482075abc179163a87e814/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ee71a5f47ee0c48a3b79aa12c26d244cbff0e26e6f482075abc179163a87e814/json HTTP/1.1" 200 None run container_id:roottests3imdssessiontoken-gw4-resolver-1 detach:True nothrow:False cmd: ['bash', '-c', 'python3 server_with_session_tokens.py 8080 >/var/log/resolver/server_with_session_tokens.log 2>/var/log/resolver/server_with_session_tokens.err.log'] run container_id:roottests3imdssessiontoken-gw4-resolver-1 detach:True nothrow:False cmd: ['bash', '-c', 'python3 server_with_session_tokens.py 8080 >/var/log/resolver/server_with_session_tokens.log 2>/var/log/resolver/server_with_session_tokens.err.log'] Command:[docker exec roottests3imdssessiontoken-gw4-resolver-1 bash -c python3 server_with_session_tokens.py 8080 >/var/log/resolver/server_with_session_tokens.log 2>/var/log/resolver/server_with_session_tokens.err.log] Command:[docker exec roottests3imdssessiontoken-gw4-resolver-1 bash -c python3 server_with_session_tokens.py 8080 >/var/log/resolver/server_with_session_tokens.log 2>/var/log/resolver/server_with_session_tokens.err.log] run container_id:roottests3imdssessiontoken-gw4-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8080/'] run container_id:roottests3imdssessiontoken-gw4-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8080/'] Command:[docker exec roottests3imdssessiontoken-gw4-resolver-1 curl -s http://localhost:8080/] Command:[docker exec roottests3imdssessiontoken-gw4-resolver-1 curl -s http://localhost:8080/] Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica' on instance Executing query select 20 on node2 Executing query select 20 on node2 http://localhost:None "GET /v1.46/containers/ee71a5f47ee0c48a3b79aa12c26d244cbff0e26e6f482075abc179163a87e814/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ee71a5f47ee0c48a3b79aa12c26d244cbff0e26e6f482075abc179163a87e814/json HTTP/1.1" 200 None ClickHouse node started ClickHouse node started Exitcode:7 Exitcode:7 Cluster started Cluster started run container_id:roottests3storageconfproxy-gw6-resolver-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname resolver.py) && echo aW1wb3J0IHJhbmRvbQoKaW1wb3J0IGJvdHRsZQoKCkBib3R0bGUucm91dGUoIi9ob3N0bmFtZSIpCmRlZiBpbmRleCgpOgogICAgaWYgcmFuZG9tLnJhbmRyYW5nZSgyKSA9PSAwOgogICAgICAgIHJldHVybiAicHJveHkxIgogICAgZWxzZToKICAgICAgICByZXR1cm4gInByb3h5MiIKCgpib3R0bGUucnVuKGhvc3Q9IjAuMC4wLjAiLCBwb3J0PTgwODApCg== | base64 --decode > resolver.py'] run container_id:roottests3storageconfproxy-gw6-resolver-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname resolver.py) && echo aW1wb3J0IHJhbmRvbQoKaW1wb3J0IGJvdHRsZQoKCkBib3R0bGUucm91dGUoIi9ob3N0bmFtZSIpCmRlZiBpbmRleCgpOgogICAgaWYgcmFuZG9tLnJhbmRyYW5nZSgyKSA9PSAwOgogICAgICAgIHJldHVybiAicHJveHkxIgogICAgZWxzZToKICAgICAgICByZXR1cm4gInByb3h5MiIKCgpib3R0bGUucnVuKGhvc3Q9IjAuMC4wLjAiLCBwb3J0PTgwODApCg== | base64 --decode > resolver.py'] Command:[docker exec roottests3storageconfproxy-gw6-resolver-1 bash -c mkdir -p $(dirname resolver.py) && echo aW1wb3J0IHJhbmRvbQoKaW1wb3J0IGJvdHRsZQoKCkBib3R0bGUucm91dGUoIi9ob3N0bmFtZSIpCmRlZiBpbmRleCgpOgogICAgaWYgcmFuZG9tLnJhbmRyYW5nZSgyKSA9PSAwOgogICAgICAgIHJldHVybiAicHJveHkxIgogICAgZWxzZToKICAgICAgICByZXR1cm4gInByb3h5MiIKCgpib3R0bGUucnVuKGhvc3Q9IjAuMC4wLjAiLCBwb3J0PTgwODApCg== | base64 --decode > resolver.py] Command:[docker exec roottests3storageconfproxy-gw6-resolver-1 bash -c mkdir -p $(dirname resolver.py) && echo aW1wb3J0IHJhbmRvbQoKaW1wb3J0IGJvdHRsZQoKCkBib3R0bGUucm91dGUoIi9ob3N0bmFtZSIpCmRlZiBpbmRleCgpOgogICAgaWYgcmFuZG9tLnJhbmRyYW5nZSgyKSA9PSAwOgogICAgICAgIHJldHVybiAicHJveHkxIgogICAgZWxzZToKICAgICAgICByZXR1cm4gInByb3h5MiIKCgpib3R0bGUucnVuKGhvc3Q9IjAuMC4wLjAiLCBwb3J0PTgwODApCg== | base64 --decode > resolver.py] run container_id:roottests3storageconfproxy-gw6-resolver-1 detach:True nothrow:False cmd: ['python', 'resolver.py'] run container_id:roottests3storageconfproxy-gw6-resolver-1 detach:True nothrow:False cmd: ['python', 'resolver.py'] Command:[docker exec roottests3storageconfproxy-gw6-resolver-1 python resolver.py] Command:[docker exec roottests3storageconfproxy-gw6-resolver-1 python resolver.py] run container_id:roottests3storageconfproxy-gw6-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://resolver:8080/hostname'] run container_id:roottests3storageconfproxy-gw6-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://resolver:8080/hostname'] Command:[docker exec roottests3storageconfproxy-gw6-resolver-1 curl -s http://resolver:8080/hostname] Command:[docker exec roottests3storageconfproxy-gw6-resolver-1 curl -s http://resolver:8080/hostname] Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.1.5' ([Errno 111] Connection refused)") Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.1.5' ([Errno 111] Connection refused)") http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/316b49c2bc2ec73a1feb85312faf0498536f32093b0f184c4590f36bc8d2f911/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/316b49c2bc2ec73a1feb85312faf0498536f32093b0f184c4590f36bc8d2f911/start HTTP/1.1" 101 0 Exitcode:7 Exitcode:7 run container_id:roottests3storageconfproxy-gw6-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://resolver:8080/hostname'] run container_id:roottests3storageconfproxy-gw6-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://resolver:8080/hostname'] Command:[docker exec roottests3storageconfproxy-gw6-resolver-1 curl -s http://resolver:8080/hostname] Command:[docker exec roottests3storageconfproxy-gw6-resolver-1 curl -s http://resolver:8080/hostname] http://localhost:None "GET /v1.46/exec/316b49c2bc2ec73a1feb85312faf0498536f32093b0f184c4590f36bc8d2f911/json HTTP/1.1" 200 460 http://localhost:None "GET /v1.46/exec/316b49c2bc2ec73a1feb85312faf0498536f32093b0f184c4590f36bc8d2f911/json HTTP/1.1" 200 460 [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-s', '172.16.8.9', '--dport', '2181', '-j', 'DROP'] (0): [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-s', '172.16.8.9', '--dport', '2181', '-j', 'DROP'] (0): http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/df17b68c17acfb3f4dc6a6e32a75f491ff925fd165afd4a72156f4df35808569/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/df17b68c17acfb3f4dc6a6e32a75f491ff925fd165afd4a72156f4df35808569/start HTTP/1.1" 101 0 Executing query select * from `postgres_database`.`postgresql_replica` order by key1; on instance Executing query select * from `postgres_database`.`postgresql_replica` order by key1; on instance http://localhost:None "GET /v1.46/exec/df17b68c17acfb3f4dc6a6e32a75f491ff925fd165afd4a72156f4df35808569/json HTTP/1.1" 200 460 http://localhost:None "GET /v1.46/exec/df17b68c17acfb3f4dc6a6e32a75f491ff925fd165afd4a72156f4df35808569/json HTTP/1.1" 200 460 [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-d', '172.16.8.9', '--sport', '2181', '-j', 'DROP'] (0): [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-d', '172.16.8.9', '--sport', '2181', '-j', 'DROP'] (0): Executing query create workload X in all settings priority = 0; on node Executing query create workload X in all settings priority = 0; on node Exitcode:7 Exitcode:7 Executing query select * from `test_database`.`postgresql_replica` order by key1; on instance Executing query select * from `test_database`.`postgresql_replica` order by key1; on instance Executing query create workload Y in all settings priority = 1; on node Executing query create workload Y in all settings priority = 1; on node Executing query SELECT * FROM `test_database`.`postgresql_replica` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica` LIMIT 1 FORMAT Null on instance Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.1.5' ([Errno 111] Connection refused)") Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.1.5' ([Errno 111] Connection refused)") Executing query create workload A1 in X settings priority = -1; on node Executing query create workload A1 in X settings priority = -1; on node Executing query select 20 on node2 Executing query select 20 on node2 Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica' on instance Executing query create workload B1 in X settings priority = 1; on node Executing query create workload B1 in X settings priority = 1; on node run container_id:roottests3imdssessiontoken-gw4-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8080/'] run container_id:roottests3imdssessiontoken-gw4-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8080/'] Command:[docker exec roottests3imdssessiontoken-gw4-resolver-1 curl -s http://localhost:8080/] Command:[docker exec roottests3imdssessiontoken-gw4-resolver-1 curl -s http://localhost:8080/] Executing query create workload C1 in Y settings priority = -1; on node Executing query create workload C1 in Y settings priority = -1; on node Executing query select * from `postgres_database`.`postgresql_replica` order by key1; on instance Executing query select * from `postgres_database`.`postgresql_replica` order by key1; on instance Stdout:OK Stdout:OK server_with_session_tokens.py answered OK on attempt 2 server_with_session_tokens.py answered OK on attempt 2 Mock server server_with_session_tokens.py started Mock server server_with_session_tokens.py started Executing query INSERT INTO FUNCTION s3('http://minio1:9001/root/test1.jsonl') SELECT * FROM numbers(100) on node Executing query INSERT INTO FUNCTION s3('http://minio1:9001/root/test1.jsonl') SELECT * FROM numbers(100) on node Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.1.5' ([Errno 111] Connection refused)") Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.1.5' ([Errno 111] Connection refused)") Executing query create workload D1 in Y settings priority = 1; on node Executing query create workload D1 in Y settings priority = 1; on node run container_id:roottests3storageconfproxy-gw6-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://resolver:8080/hostname'] run container_id:roottests3storageconfproxy-gw6-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://resolver:8080/hostname'] Command:[docker exec roottests3storageconfproxy-gw6-resolver-1 curl -s http://resolver:8080/hostname] Command:[docker exec roottests3storageconfproxy-gw6-resolver-1 curl -s http://resolver:8080/hostname] Stdout:proxy1 Stdout:proxy1 Proxy resolver started Proxy resolver started Executing query CREATE TABLE s3_test ( id Int64, data String ) ENGINE=MergeTree() ORDER BY id SETTINGS storage_policy='s3' on node Executing query CREATE TABLE s3_test ( id Int64, data String ) ENGINE=MergeTree() ORDER BY id SETTINGS storage_policy='s3' on node Executing query select * from `test_database`.`postgresql_replica` order by key1; on instance Executing query select * from `test_database`.`postgresql_replica` order by key1; on instance Executing query select 20 on node2 Executing query select 20 on node2 Executing query SELECT count() FROM s3('http://minio1:9001/root/test1.jsonl') on node Executing query SELECT count() FROM s3('http://minio1:9001/root/test1.jsonl') on node Executing query create workload A2 in X settings priority = -1; on node Executing query create workload A2 in X settings priority = -1; on node Executing query SELECT * FROM `test_database`.`postgresql_replica` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica` LIMIT 1 FORMAT Null on instance Executing query INSERT INTO s3_test VALUES (0,'data'),(1,'data') on node Executing query INSERT INTO s3_test VALUES (0,'data'),(1,'data') on node Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.1.5' ([Errno 111] Connection refused)") Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.1.5' ([Errno 111] Connection refused)") Executing query create workload B2 in X settings priority = 1; on node Executing query create workload B2 in X settings priority = 1; on node Executing query SYSTEM FLUSH LOGS on node Executing query SYSTEM FLUSH LOGS on node Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo2 get_instance_ip instance_name=zoo2 http://localhost:None "GET /v1.46/containers/roottestreloadauxiliaryzookeepers-gw0-zoo2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadauxiliaryzookeepers-gw0-zoo2-1/json HTTP/1.1" 200 None get_kazoo_client: zoo2, ip:172.16.2.3, port:2181, use_ssl:False get_kazoo_client: zoo2, ip:172.16.2.3, port:2181, use_ssl:False Connecting to 172.16.2.3(172.16.2.3):2181, use_ssl: False Connecting to 172.16.2.3(172.16.2.3):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Executing query create workload C2 in Y settings priority = -1; on node Executing query create workload C2 in Y settings priority = -1; on node Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica' on instance Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo3 get_instance_ip instance_name=zoo3 http://localhost:None "GET /v1.46/containers/roottestreloadauxiliaryzookeepers-gw0-zoo3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadauxiliaryzookeepers-gw0-zoo3-1/json HTTP/1.1" 200 None get_kazoo_client: zoo3, ip:172.16.2.2, port:2181, use_ssl:False get_kazoo_client: zoo3, ip:172.16.2.2, port:2181, use_ssl:False Connecting to 172.16.2.2(172.16.2.2):2181, use_ssl: False Connecting to 172.16.2.2(172.16.2.2):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Executing query SELECT * FROM s3_test order by id FORMAT Values on node Executing query SELECT * FROM s3_test order by id FORMAT Values on node Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/.env --project-name roottestreloadauxiliaryzookeepers-gw0 --file /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/.env --project-name roottestreloadauxiliaryzookeepers-gw0 --file /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/.env --project-name roottestreloadauxiliaryzookeepers-gw0 --file /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/.env --project-name roottestreloadauxiliaryzookeepers-gw0 --file /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml up -d --no-recreate] Executing query create workload D2 in Y settings priority = 1; on node Executing query create workload D2 in Y settings priority = 1; on node Executing query select 20 on node2 Executing query select 20 on node2 Executing query select * from `postgres_database`.`postgresql_replica` order by key1; on instance Executing query select * from `postgres_database`.`postgresql_replica` order by key1; on instance Executing query DROP TABLE IF EXISTS s3_test SYNC on node Executing query DROP TABLE IF EXISTS s3_test SYNC on node Mysql 8 Started Mysql 8 Started ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/.env --project-name roottestrestoreexternalengines-gw9 --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_mysql_8_0.yml --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica2/docker-compose.yml --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica3/docker-compose.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/.env --project-name roottestrestoreexternalengines-gw9 --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_mysql_8_0.yml --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica2/docker-compose.yml --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica3/docker-compose.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/.env --project-name roottestrestoreexternalengines-gw9 --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_mysql_8_0.yml --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica2/docker-compose.yml --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica3/docker-compose.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/.env --project-name roottestrestoreexternalengines-gw9 --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_mysql_8_0.yml --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica2/docker-compose.yml --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica3/docker-compose.yml up -d --no-recreate] http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/0e160882a31885974046ab0b86396470e76cdb02d0205c2bc87835c9d83b507e/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/0e160882a31885974046ab0b86396470e76cdb02d0205c2bc87835c9d83b507e/start HTTP/1.1" 101 0 Executing query select * from `test_database`.`postgresql_replica` order by key1; on instance Executing query select * from `test_database`.`postgresql_replica` order by key1; on instance Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo3-1 Running Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo3-1 Running Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo1-1 Running Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo1-1 Running Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo2-1 Running Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo2-1 Running Stderr: Container roottestreloadauxiliaryzookeepers-gw0-node-1 Creating Stderr: Container roottestreloadauxiliaryzookeepers-gw0-node-1 Creating Stderr: Container roottestreloadauxiliaryzookeepers-gw0-node-1 Created Stderr: Container roottestreloadauxiliaryzookeepers-gw0-node-1 Created Stderr: Container roottestreloadauxiliaryzookeepers-gw0-node-1 Starting Stderr: Container roottestreloadauxiliaryzookeepers-gw0-node-1 Starting Stderr: Container roottestreloadauxiliaryzookeepers-gw0-node-1 Started Stderr: Container roottestreloadauxiliaryzookeepers-gw0-node-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottestreloadauxiliaryzookeepers-gw0-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadauxiliaryzookeepers-gw0-node-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottestreloadauxiliaryzookeepers-gw0-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadauxiliaryzookeepers-gw0-node-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node, ip: 172.16.2.5... Waiting for ClickHouse start in node, ip: 172.16.2.5... http://localhost:None "GET /v1.46/containers/roottestreloadauxiliaryzookeepers-gw0-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadauxiliaryzookeepers-gw0-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/1faeb46c1804ad611f89fec9f393905706752a7002dd75fc880fcc65e262389e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/1faeb46c1804ad611f89fec9f393905706752a7002dd75fc880fcc65e262389e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/exec/0e160882a31885974046ab0b86396470e76cdb02d0205c2bc87835c9d83b507e/json HTTP/1.1" 200 456 http://localhost:None "GET /v1.46/exec/0e160882a31885974046ab0b86396470e76cdb02d0205c2bc87835c9d83b507e/json HTTP/1.1" 200 456 [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-d', '172.16.8.9', '--sport', '2181', '-j', 'DROP'] (0): [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-d', '172.16.8.9', '--sport', '2181', '-j', 'DROP'] (0): http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/42f1177b492a0bf5fb3b4f4bc7517522610d2b5d3173b38b23b5020ca601e21a/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/42f1177b492a0bf5fb3b4f4bc7517522610d2b5d3173b38b23b5020ca601e21a/start HTTP/1.1" 101 0 Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node http://localhost:None "GET /v1.46/containers/1faeb46c1804ad611f89fec9f393905706752a7002dd75fc880fcc65e262389e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/exec/42f1177b492a0bf5fb3b4f4bc7517522610d2b5d3173b38b23b5020ca601e21a/json HTTP/1.1" 200 456 http://localhost:None "GET /v1.46/exec/42f1177b492a0bf5fb3b4f4bc7517522610d2b5d3173b38b23b5020ca601e21a/json HTTP/1.1" 200 456 http://localhost:None "GET /v1.46/containers/1faeb46c1804ad611f89fec9f393905706752a7002dd75fc880fcc65e262389e/json HTTP/1.1" 200 None [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-s', '172.16.8.9', '--dport', '2181', '-j', 'DROP'] (0): [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-s', '172.16.8.9', '--dport', '2181', '-j', 'DROP'] (0): Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance [gw1] PASSED test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index http://localhost:None "GET /v1.46/containers/1faeb46c1804ad611f89fec9f393905706752a7002dd75fc880fcc65e262389e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/1faeb46c1804ad611f89fec9f393905706752a7002dd75fc880fcc65e262389e/json HTTP/1.1" 200 None run container_id:roottests3imdssessiontoken-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', '[ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService to get token" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true'] run container_id:roottests3imdssessiontoken-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', '[ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService to get token" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true'] Command:[docker exec roottests3imdssessiontoken-gw4-node-1 bash -c [ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService to get token" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker exec roottests3imdssessiontoken-gw4-node-1 bash -c [ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService to get token" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true] Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:54:44.075602 [ 9 ] {bbbee333-71f5-444e-8619-1c0a48ca5e79} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService to get token. Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:54:44.075602 [ 9 ] {bbbee333-71f5-444e-8619-1c0a48ca5e79} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService to get token. Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:54:44.297702 [ 9 ] {1dc1cb71-2dc8-437e-af4f-339c658044b3} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService to get token. Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:54:44.297702 [ 9 ] {1dc1cb71-2dc8-437e-af4f-339c658044b3} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService to get token. run container_id:roottests3imdssessiontoken-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', '[ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource, /latest/meta-data/iam/security-credentials with token returned profile string myrole" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true'] run container_id:roottests3imdssessiontoken-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', '[ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource, /latest/meta-data/iam/security-credentials with token returned profile string myrole" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true'] Command:[docker exec roottests3imdssessiontoken-gw4-node-1 bash -c [ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource, /latest/meta-data/iam/security-credentials with token returned profile string myrole" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker exec roottests3imdssessiontoken-gw4-node-1 bash -c [ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource, /latest/meta-data/iam/security-credentials with token returned profile string myrole" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true] http://localhost:None "GET /v1.46/containers/1faeb46c1804ad611f89fec9f393905706752a7002dd75fc880fcc65e262389e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/1faeb46c1804ad611f89fec9f393905706752a7002dd75fc880fcc65e262389e/json HTTP/1.1" 200 None Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:54:44.077653 [ 9 ] {bbbee333-71f5-444e-8619-1c0a48ca5e79} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource, /latest/meta-data/iam/security-credentials with token returned profile string myrole. Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:54:44.077653 [ 9 ] {bbbee333-71f5-444e-8619-1c0a48ca5e79} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource, /latest/meta-data/iam/security-credentials with token returned profile string myrole. Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:54:44.299386 [ 9 ] {1dc1cb71-2dc8-437e-af4f-339c658044b3} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource, /latest/meta-data/iam/security-credentials with token returned profile string myrole. Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:54:44.299386 [ 9 ] {1dc1cb71-2dc8-437e-af4f-339c658044b3} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource, /latest/meta-data/iam/security-credentials with token returned profile string myrole. run container_id:roottests3imdssessiontoken-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', '[ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource resolver:8080/latest/meta-data/iam/security-credentials/myrole with token" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true'] run container_id:roottests3imdssessiontoken-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', '[ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource resolver:8080/latest/meta-data/iam/security-credentials/myrole with token" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true'] Command:[docker exec roottests3imdssessiontoken-gw4-node-1 bash -c [ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource resolver:8080/latest/meta-data/iam/security-credentials/myrole with token" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker exec roottests3imdssessiontoken-gw4-node-1 bash -c [ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource resolver:8080/latest/meta-data/iam/security-credentials/myrole with token" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true] Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:54:44.077741 [ 9 ] {bbbee333-71f5-444e-8619-1c0a48ca5e79} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource resolver:8080/latest/meta-data/iam/security-credentials/myrole with token. Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:54:44.077741 [ 9 ] {bbbee333-71f5-444e-8619-1c0a48ca5e79} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource resolver:8080/latest/meta-data/iam/security-credentials/myrole with token. Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:54:44.299482 [ 9 ] {1dc1cb71-2dc8-437e-af4f-339c658044b3} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource resolver:8080/latest/meta-data/iam/security-credentials/myrole with token. Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:54:44.299482 [ 9 ] {1dc1cb71-2dc8-437e-af4f-339c658044b3} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource resolver:8080/latest/meta-data/iam/security-credentials/myrole with token. run container_id:roottests3imdssessiontoken-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', '[ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Successfully pulled credentials from EC2MetadataService with access key" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true'] run container_id:roottests3imdssessiontoken-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', '[ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Successfully pulled credentials from EC2MetadataService with access key" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true'] Command:[docker exec roottests3imdssessiontoken-gw4-node-1 bash -c [ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Successfully pulled credentials from EC2MetadataService with access key" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker exec roottests3imdssessiontoken-gw4-node-1 bash -c [ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Successfully pulled credentials from EC2MetadataService with access key" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true] Executing query select 20 on node2 Executing query select 20 on node2 http://localhost:None "GET /v1.46/containers/1faeb46c1804ad611f89fec9f393905706752a7002dd75fc880fcc65e262389e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/1faeb46c1804ad611f89fec9f393905706752a7002dd75fc880fcc65e262389e/json HTTP/1.1" 200 None Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:54:44.078336 [ 9 ] {bbbee333-71f5-444e-8619-1c0a48ca5e79} AWSEC2InstanceProfileConfigLoader: Successfully pulled credentials from EC2MetadataService with access key. Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:54:44.078336 [ 9 ] {bbbee333-71f5-444e-8619-1c0a48ca5e79} AWSEC2InstanceProfileConfigLoader: Successfully pulled credentials from EC2MetadataService with access key. Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:54:44.300276 [ 9 ] {1dc1cb71-2dc8-437e-af4f-339c658044b3} AWSEC2InstanceProfileConfigLoader: Successfully pulled credentials from EC2MetadataService with access key. Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:54:44.300276 [ 9 ] {1dc1cb71-2dc8-437e-af4f-339c658044b3} AWSEC2InstanceProfileConfigLoader: Successfully pulled credentials from EC2MetadataService with access key. Stderr: Container roottestrestoreexternalengines-gw9-mysql80-1 Running Stderr: Container roottestrestoreexternalengines-gw9-mysql80-1 Running Stderr: Container roottestrestoreexternalengines-gw9-zoo1-1 Running Stderr: Container roottestrestoreexternalengines-gw9-zoo1-1 Running Stderr: Container roottestrestoreexternalengines-gw9-zoo2-1 Running Stderr: Container roottestrestoreexternalengines-gw9-zoo2-1 Running Stderr: Container roottestrestoreexternalengines-gw9-zoo3-1 Running Stderr: Container roottestrestoreexternalengines-gw9-zoo3-1 Running Stderr: Container roottestrestoreexternalengines-gw9-replica2-1 Creating Stderr: Container roottestrestoreexternalengines-gw9-replica2-1 Creating Stderr: Container roottestrestoreexternalengines-gw9-replica3-1 Creating Stderr: Container roottestrestoreexternalengines-gw9-replica3-1 Creating Stderr: Container roottestrestoreexternalengines-gw9-replica1-1 Creating Stderr: Container roottestrestoreexternalengines-gw9-replica1-1 Creating Stderr: Container roottestrestoreexternalengines-gw9-replica3-1 Created Stderr: Container roottestrestoreexternalengines-gw9-replica3-1 Created Stderr: Container roottestrestoreexternalengines-gw9-replica2-1 Created Stderr: Container roottestrestoreexternalengines-gw9-replica2-1 Created Stderr: Container roottestrestoreexternalengines-gw9-replica1-1 Created Stderr: Container roottestrestoreexternalengines-gw9-replica1-1 Created Stderr: Container roottestrestoreexternalengines-gw9-replica3-1 Starting Stderr: Container roottestrestoreexternalengines-gw9-replica3-1 Starting Stderr: Container roottestrestoreexternalengines-gw9-replica2-1 Starting Stderr: Container roottestrestoreexternalengines-gw9-replica2-1 Starting Stderr: Container roottestrestoreexternalengines-gw9-replica1-1 Starting [gw4] PASSED test_s3_imds/test_session_token.py::test_credentials_from_metadata Stderr: Container roottestrestoreexternalengines-gw9-replica1-1 Starting Stderr: Container roottestrestoreexternalengines-gw9-replica3-1 Started Stderr: Container roottestrestoreexternalengines-gw9-replica3-1 Started Stderr: Container roottestrestoreexternalengines-gw9-replica2-1 Started Stderr: Container roottestrestoreexternalengines-gw9-replica2-1 Started Stderr: Container roottestrestoreexternalengines-gw9-replica1-1 Started Stderr: Container roottestrestoreexternalengines-gw9-replica1-1 Started ClickHouse instance created ClickHouse instance created Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/.env --project-name roottests3imdssessiontoken-gw4 --file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/.env --project-name roottests3imdssessiontoken-gw4 --file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml stop --timeout 20] get_instance_ip instance_name=replica1 get_instance_ip instance_name=replica1 http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw9-replica1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw9-replica1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=replica1 get_instance_ip instance_name=replica1 http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw9-replica1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw9-replica1-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in replica1, ip: 172.16.1.8... Waiting for ClickHouse start in replica1, ip: 172.16.1.8... http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw9-replica1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw9-replica1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/fb0cc44c9710f9f1a635ef8c96dea825a1ac4b65baa8414b49d949e80c0694dc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/fb0cc44c9710f9f1a635ef8c96dea825a1ac4b65baa8414b49d949e80c0694dc/json HTTP/1.1" 200 None Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance http://localhost:None "GET /v1.46/containers/1faeb46c1804ad611f89fec9f393905706752a7002dd75fc880fcc65e262389e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/1faeb46c1804ad611f89fec9f393905706752a7002dd75fc880fcc65e262389e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/fb0cc44c9710f9f1a635ef8c96dea825a1ac4b65baa8414b49d949e80c0694dc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/fb0cc44c9710f9f1a635ef8c96dea825a1ac4b65baa8414b49d949e80c0694dc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/1faeb46c1804ad611f89fec9f393905706752a7002dd75fc880fcc65e262389e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/1faeb46c1804ad611f89fec9f393905706752a7002dd75fc880fcc65e262389e/json HTTP/1.1" 200 None Executing query select name, create_query from system.resources order by all on node Executing query select name, create_query from system.resources order by all on node http://localhost:None "GET /v1.46/containers/fb0cc44c9710f9f1a635ef8c96dea825a1ac4b65baa8414b49d949e80c0694dc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/fb0cc44c9710f9f1a635ef8c96dea825a1ac4b65baa8414b49d949e80c0694dc/json HTTP/1.1" 200 None Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance http://localhost:None "GET /v1.46/containers/1faeb46c1804ad611f89fec9f393905706752a7002dd75fc880fcc65e262389e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/1faeb46c1804ad611f89fec9f393905706752a7002dd75fc880fcc65e262389e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/fb0cc44c9710f9f1a635ef8c96dea825a1ac4b65baa8414b49d949e80c0694dc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/fb0cc44c9710f9f1a635ef8c96dea825a1ac4b65baa8414b49d949e80c0694dc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/1faeb46c1804ad611f89fec9f393905706752a7002dd75fc880fcc65e262389e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/1faeb46c1804ad611f89fec9f393905706752a7002dd75fc880fcc65e262389e/json HTTP/1.1" 200 None Executing query select name, create_query from system.resources order by all on node2 Executing query select name, create_query from system.resources order by all on node2 http://localhost:None "GET /v1.46/containers/fb0cc44c9710f9f1a635ef8c96dea825a1ac4b65baa8414b49d949e80c0694dc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/fb0cc44c9710f9f1a635ef8c96dea825a1ac4b65baa8414b49d949e80c0694dc/json HTTP/1.1" 200 None Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance http://localhost:None "GET /v1.46/containers/1faeb46c1804ad611f89fec9f393905706752a7002dd75fc880fcc65e262389e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/1faeb46c1804ad611f89fec9f393905706752a7002dd75fc880fcc65e262389e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/fb0cc44c9710f9f1a635ef8c96dea825a1ac4b65baa8414b49d949e80c0694dc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/fb0cc44c9710f9f1a635ef8c96dea825a1ac4b65baa8414b49d949e80c0694dc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/1faeb46c1804ad611f89fec9f393905706752a7002dd75fc880fcc65e262389e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/1faeb46c1804ad611f89fec9f393905706752a7002dd75fc880fcc65e262389e/json HTTP/1.1" 200 None Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node http://localhost:None "GET /v1.46/containers/fb0cc44c9710f9f1a635ef8c96dea825a1ac4b65baa8414b49d949e80c0694dc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/fb0cc44c9710f9f1a635ef8c96dea825a1ac4b65baa8414b49d949e80c0694dc/json HTTP/1.1" 200 None run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] test_postgresql_replica_database_engine_1/test.py::test_replicating_dml Executing query INSERT INTO postgres_database.postgresql_replica_0 SELECT number, 0 from numbers(50) on instance Executing query INSERT INTO postgres_database.postgresql_replica_0 SELECT number, 0 from numbers(50) on instance Stdout:806 Stdout:806 ERROR Client failed! Return code: 210, stderr: Code: 210. DB::NetException: Connection refused (172.16.9.5:9000). (NETWORK_ERROR) ERROR Client failed! Return code: 210, stderr: Code: 210. DB::NetException: Connection refused (172.16.9.5:9000). (NETWORK_ERROR) run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] http://localhost:None "GET /v1.46/containers/1faeb46c1804ad611f89fec9f393905706752a7002dd75fc880fcc65e262389e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/1faeb46c1804ad611f89fec9f393905706752a7002dd75fc880fcc65e262389e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None Stdout:806 Stdout:806 Executing query select 20 on node2 Executing query select 20 on node2 http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/fb0cc44c9710f9f1a635ef8c96dea825a1ac4b65baa8414b49d949e80c0694dc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/fb0cc44c9710f9f1a635ef8c96dea825a1ac4b65baa8414b49d949e80c0694dc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/1faeb46c1804ad611f89fec9f393905706752a7002dd75fc880fcc65e262389e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/1faeb46c1804ad611f89fec9f393905706752a7002dd75fc880fcc65e262389e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/fb0cc44c9710f9f1a635ef8c96dea825a1ac4b65baa8414b49d949e80c0694dc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/fb0cc44c9710f9f1a635ef8c96dea825a1ac4b65baa8414b49d949e80c0694dc/json HTTP/1.1" 200 None Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node2 Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node2 Executing query INSERT INTO postgres_database.postgresql_replica_1 SELECT number, 1 from numbers(50) on instance Executing query INSERT INTO postgres_database.postgresql_replica_1 SELECT number, 1 from numbers(50) on instance http://localhost:None "GET /v1.46/containers/1faeb46c1804ad611f89fec9f393905706752a7002dd75fc880fcc65e262389e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/1faeb46c1804ad611f89fec9f393905706752a7002dd75fc880fcc65e262389e/json HTTP/1.1" 200 None ClickHouse node started ClickHouse node started Executing query CREATE TABLE simple (date Date, id UInt32) ENGINE = ReplicatedMergeTree('/clickhouse/tables/0/simple', 'node') ORDER BY tuple() PARTITION BY date; on node Executing query CREATE TABLE simple (date Date, id UInt32) ENGINE = ReplicatedMergeTree('/clickhouse/tables/0/simple', 'node') ORDER BY tuple() PARTITION BY date; on node http://localhost:None "GET /v1.46/containers/fb0cc44c9710f9f1a635ef8c96dea825a1ac4b65baa8414b49d949e80c0694dc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/fb0cc44c9710f9f1a635ef8c96dea825a1ac4b65baa8414b49d949e80c0694dc/json HTTP/1.1" 200 None Executing query SELECT create_query FROM system.functions WHERE name='f1' on node2 Executing query SELECT create_query FROM system.functions WHERE name='f1' on node2 http://localhost:None "GET /v1.46/containers/fb0cc44c9710f9f1a635ef8c96dea825a1ac4b65baa8414b49d949e80c0694dc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/fb0cc44c9710f9f1a635ef8c96dea825a1ac4b65baa8414b49d949e80c0694dc/json HTTP/1.1" 200 None http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/fb89599cb5b9d45d8907af7fff7919a7f63a74871ba7524cb1d4bd986eafd8f4/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/fb89599cb5b9d45d8907af7fff7919a7f63a74871ba7524cb1d4bd986eafd8f4/start HTTP/1.1" 101 0 Executing query INSERT INTO postgres_database.postgresql_replica_2 SELECT number, 2 from numbers(50) on instance Executing query INSERT INTO postgres_database.postgresql_replica_2 SELECT number, 2 from numbers(50) on instance http://localhost:None "GET /v1.46/exec/fb89599cb5b9d45d8907af7fff7919a7f63a74871ba7524cb1d4bd986eafd8f4/json HTTP/1.1" 200 460 http://localhost:None "GET /v1.46/exec/fb89599cb5b9d45d8907af7fff7919a7f63a74871ba7524cb1d4bd986eafd8f4/json HTTP/1.1" 200 460 [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-s', '172.16.8.9', '--dport', '2181', '-j', 'DROP'] (0): [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-s', '172.16.8.9', '--dport', '2181', '-j', 'DROP'] (0): http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/93f9f29262249c762f2cf3cadcd695b25519cff742157e6b59c735e6dac44e14/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/93f9f29262249c762f2cf3cadcd695b25519cff742157e6b59c735e6dac44e14/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/containers/fb0cc44c9710f9f1a635ef8c96dea825a1ac4b65baa8414b49d949e80c0694dc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/fb0cc44c9710f9f1a635ef8c96dea825a1ac4b65baa8414b49d949e80c0694dc/json HTTP/1.1" 200 None Executing query INSERT INTO simple VALUES ('2020-08-27', 1) on node Executing query INSERT INTO simple VALUES ('2020-08-27', 1) on node http://localhost:None "GET /v1.46/exec/93f9f29262249c762f2cf3cadcd695b25519cff742157e6b59c735e6dac44e14/json HTTP/1.1" 200 460 http://localhost:None "GET /v1.46/exec/93f9f29262249c762f2cf3cadcd695b25519cff742157e6b59c735e6dac44e14/json HTTP/1.1" 200 460 [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-d', '172.16.8.9', '--sport', '2181', '-j', 'DROP'] (0): [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-d', '172.16.8.9', '--sport', '2181', '-j', 'DROP'] (0): Executing query drop workload A1; on node Executing query drop workload A1; on node Starting zookeeper node: zoo1 Starting zookeeper node: zoo1 Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml start zoo1] Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml start zoo1] http://localhost:None "GET /v1.46/containers/fb0cc44c9710f9f1a635ef8c96dea825a1ac4b65baa8414b49d949e80c0694dc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/fb0cc44c9710f9f1a635ef8c96dea825a1ac4b65baa8414b49d949e80c0694dc/json HTTP/1.1" 200 None Executing query INSERT INTO postgres_database.postgresql_replica_3 SELECT number, 3 from numbers(50) on instance Executing query INSERT INTO postgres_database.postgresql_replica_3 SELECT number, 3 from numbers(50) on instance Executing query drop workload A2; on node Executing query drop workload A2; on node http://localhost:None "GET /v1.46/containers/fb0cc44c9710f9f1a635ef8c96dea825a1ac4b65baa8414b49d949e80c0694dc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/fb0cc44c9710f9f1a635ef8c96dea825a1ac4b65baa8414b49d949e80c0694dc/json HTTP/1.1" 200 None ClickHouse replica1 started ClickHouse replica1 started get_instance_ip instance_name=replica2 get_instance_ip instance_name=replica2 http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw9-replica2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw9-replica2-1/json HTTP/1.1" 200 None get_instance_ip instance_name=replica2 get_instance_ip instance_name=replica2 http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw9-replica2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw9-replica2-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in replica2, ip: 172.16.1.7... Waiting for ClickHouse start in replica2, ip: 172.16.1.7... http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw9-replica2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw9-replica2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/aa5141355cc64df5a766a3dc437945982a76036fadee501845abd3b46c03a22f/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/aa5141355cc64df5a766a3dc437945982a76036fadee501845abd3b46c03a22f/json HTTP/1.1" 200 None ClickHouse replica2 started ClickHouse replica2 started get_instance_ip instance_name=replica3 get_instance_ip instance_name=replica3 http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw9-replica3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw9-replica3-1/json HTTP/1.1" 200 None get_instance_ip instance_name=replica3 get_instance_ip instance_name=replica3 http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw9-replica3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw9-replica3-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in replica3, ip: 172.16.1.6... Waiting for ClickHouse start in replica3, ip: 172.16.1.6... http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw9-replica3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw9-replica3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/c902881b8b5af2869757851e53b4492a7f2878fab63e16245c14b71156b3308c/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/c902881b8b5af2869757851e53b4492a7f2878fab63e16245c14b71156b3308c/json HTTP/1.1" 200 None ClickHouse replica3 started ClickHouse replica3 started Executing query DROP DATABASE IF EXISTS replicated SYNC on replica1 Executing query DROP DATABASE IF EXISTS replicated SYNC on replica1 Executing query CREATE TABLE simple2 (date Date, id UInt32) ENGINE = ReplicatedMergeTree('/clickhouse/tables/1/simple', 'node') ORDER BY tuple() PARTITION BY date; on node Executing query CREATE TABLE simple2 (date Date, id UInt32) ENGINE = ReplicatedMergeTree('/clickhouse/tables/1/simple', 'node') ORDER BY tuple() PARTITION BY date; on node Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Starting Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Starting Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Started Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Started Starting zookeeper node: zoo2 Starting zookeeper node: zoo2 Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml start zoo2] Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml start zoo2] Executing query drop workload B1; on node Executing query drop workload B1; on node Executing query DROP DATABASE IF EXISTS replicated SYNC on replica2 Executing query DROP DATABASE IF EXISTS replicated SYNC on replica2 Executing query INSERT INTO postgres_database.postgresql_replica_4 SELECT number, 4 from numbers(50) on instance Executing query INSERT INTO postgres_database.postgresql_replica_4 SELECT number, 4 from numbers(50) on instance run container_id:roottestreloadauxiliaryzookeepers-gw0-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo \'\n \n \n zoo1\n 2181\n \n \n zoo2\n 2181\n \n \n zoo3\n 2181\n \n 2000\n \n \n \n \n zoo1\n 2181\n \n \n zoo2\n 2181\n \n \n \n\' > /etc/clickhouse-server/conf.d/zookeeper_config.xml'] run container_id:roottestreloadauxiliaryzookeepers-gw0-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo \'\n \n \n zoo1\n 2181\n \n \n zoo2\n 2181\n \n \n zoo3\n 2181\n \n 2000\n \n \n \n \n zoo1\n 2181\n \n \n zoo2\n 2181\n \n \n \n\' > /etc/clickhouse-server/conf.d/zookeeper_config.xml'] Command:[docker exec roottestreloadauxiliaryzookeepers-gw0-node-1 bash -c echo ' zoo1 2181 zoo2 2181 zoo3 2181 2000 zoo1 2181 zoo2 2181 ' > /etc/clickhouse-server/conf.d/zookeeper_config.xml] Command:[docker exec roottestreloadauxiliaryzookeepers-gw0-node-1 bash -c echo ' zoo1 2181 zoo2 2181 zoo3 2181 2000 zoo1 2181 zoo2 2181 ' > /etc/clickhouse-server/conf.d/zookeeper_config.xml] Executing query SYSTEM RELOAD CONFIG on node Executing query SYSTEM RELOAD CONFIG on node http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None Executing query DROP DATABASE IF EXISTS replicated SYNC on replica3 Executing query DROP DATABASE IF EXISTS replicated SYNC on replica3 http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Executing query drop workload B2; on node Executing query drop workload B2; on node Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Starting Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Starting Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Started Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Started Starting zookeeper node: zoo3 Starting zookeeper node: zoo3 Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml start zoo3] Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml start zoo3] Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query CREATE DATABASE replicated ENGINE = Replicated('/clickhouse/databases/replicated', 'default', 'replica1') on replica1 Executing query CREATE DATABASE replicated ENGINE = Replicated('/clickhouse/databases/replicated', 'default', 'replica1') on replica1 Executing query drop workload C1; on node Executing query drop workload C1; on node Executing query drop workload C2; on node Executing query drop workload C2; on node Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE replicated ENGINE = Replicated('/clickhouse/databases/replicated', 'default', 'replica2') on replica2 Executing query CREATE DATABASE replicated ENGINE = Replicated('/clickhouse/databases/replicated', 'default', 'replica2') on replica2 Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Starting Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Starting Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Started Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Started get_instance_ip instance_name=zoo1 get_instance_ip instance_name=zoo1 http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-zoo1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-zoo1-1/json HTTP/1.1" 200 None get_kazoo_client: zoo1, ip:172.16.9.2, port:2181, use_ssl:False get_kazoo_client: zoo1, ip:172.16.9.2, port:2181, use_ssl:False Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query SHOW DATABASES on instance Executing query SHOW DATABASES on instance Executing query drop workload D1; on node Executing query drop workload D1; on node Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query drop workload D2; on node Executing query drop workload D2; on node Executing query CREATE DATABASE replicated ENGINE = Replicated('/clickhouse/databases/replicated', 'default', 'replica3') on replica3 Executing query CREATE DATABASE replicated ENGINE = Replicated('/clickhouse/databases/replicated', 'default', 'replica3') on replica3 Executing query INSERT INTO postgres_database.postgresql_replica_0 SELECT 50 + number, 0 from numbers(1000) on instance Executing query INSERT INTO postgres_database.postgresql_replica_0 SELECT 50 + number, 0 from numbers(1000) on instance http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Executing query create workload Z in all; on node Executing query create workload Z in all; on node Executing query CREATE TABLE replicated.example_s3_engine_table (name String, value UInt32) ENGINE = S3('https://clickhouse-public-datasets.s3.amazonaws.com/my-test-bucket-768/test-data.csv.gz', 'CSV', 'gzip') SETTINGS input_format_with_names_use_header = 0 on replica1 Executing query CREATE TABLE replicated.example_s3_engine_table (name String, value UInt32) ENGINE = S3('https://clickhouse-public-datasets.s3.amazonaws.com/my-test-bucket-768/test-data.csv.gz', 'CSV', 'gzip') SETTINGS input_format_with_names_use_header = 0 on replica1 Executing query INSERT INTO postgres_database.postgresql_replica_1 SELECT 50 + number, 1 from numbers(1000) on instance Executing query INSERT INTO postgres_database.postgresql_replica_1 SELECT 50 + number, 1 from numbers(1000) on instance Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query create workload A1 in Z settings priority = -1; on node Executing query create workload A1 in Z settings priority = -1; on node Executing query INSERT INTO postgres_database.postgresql_replica_2 SELECT 50 + number, 2 from numbers(1000) on instance Executing query INSERT INTO postgres_database.postgresql_replica_2 SELECT 50 + number, 2 from numbers(1000) on instance Executing query create workload A2 in Z settings priority = -1; on node Executing query create workload A2 in Z settings priority = -1; on node Executing query CREATE TABLE replicated.mysql_schema_inference_engine ENGINE=MySQL('mysql80:3306', 'clickhouse', 'inference_table', 'root', 'clickhouse') on replica1 Executing query CREATE TABLE replicated.mysql_schema_inference_engine ENGINE=MySQL('mysql80:3306', 'clickhouse', 'inference_table', 'root', 'clickhouse') on replica1 Executing query INSERT INTO postgres_database.postgresql_replica_3 SELECT 50 + number, 3 from numbers(1000) on instance Executing query INSERT INTO postgres_database.postgresql_replica_3 SELECT 50 + number, 3 from numbers(1000) on instance Executing query create workload A3 in Z settings priority = -1; on node Executing query create workload A3 in Z settings priority = -1; on node Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query CREATE TABLE replicated.mysql_schema_inference_function AS mysql('mysql80:3306', 'clickhouse', 'inference_table', 'root', 'clickhouse') on replica1 Executing query CREATE TABLE replicated.mysql_schema_inference_function AS mysql('mysql80:3306', 'clickhouse', 'inference_table', 'root', 'clickhouse') on replica1 Executing query INSERT INTO postgres_database.postgresql_replica_4 SELECT 50 + number, 4 from numbers(1000) on instance Executing query INSERT INTO postgres_database.postgresql_replica_4 SELECT 50 + number, 4 from numbers(1000) on instance Executing query create workload B1 in Z settings priority = 1; on node Executing query create workload B1 in Z settings priority = 1; on node http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Executing query create workload B2 in Z settings priority = 1; on node Executing query create workload B2 in Z settings priority = 1; on node Executing query CREATE TABLE replicated.merge_tree (id UInt64, b String) ORDER BY id on replica1 Executing query CREATE TABLE replicated.merge_tree (id UInt64, b String) ORDER BY id on replica1 Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance Executing query create workload B3 in Z settings priority = 1; on node Executing query create workload B3 in Z settings priority = 1; on node Executing query INSERT INTO replicated.merge_tree VALUES (100, 'abc') on replica1 Executing query INSERT INTO replicated.merge_tree VALUES (100, 'abc') on replica1 Executing query create workload C1 in X settings priority = -1; on node Executing query create workload C1 in X settings priority = -1; on node Executing query select * from `postgres_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_0` order by key; on instance Executing query DESCRIBE TABLE replicated.mysql_schema_inference_engine on replica1 Executing query DESCRIBE TABLE replicated.mysql_schema_inference_engine on replica1 Executing query create workload C2 in X settings priority = -1; on node Executing query create workload C2 in X settings priority = -1; on node Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query create workload C3 in X settings priority = -1; on node Executing query create workload C3 in X settings priority = -1; on node Executing query SELECT * FROM `test_database`.`postgresql_replica_1` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_1` LIMIT 1 FORMAT Null on instance Executing query DESCRIBE TABLE replicated.mysql_schema_inference_function on replica1 Executing query DESCRIBE TABLE replicated.mysql_schema_inference_function on replica1 http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Executing query create workload D1 in X settings priority = 1; on node Executing query create workload D1 in X settings priority = 1; on node Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_1' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_1' on instance Executing query SELECT id FROM mysql('mysql80:3306', 'clickhouse', 'inference_table', 'root', 'clickhouse') on replica1 Executing query SELECT id FROM mysql('mysql80:3306', 'clickhouse', 'inference_table', 'root', 'clickhouse') on replica1 Executing query create workload D2 in X settings priority = 1; on node Executing query create workload D2 in X settings priority = 1; on node Executing query select * from `postgres_database`.`postgresql_replica_1` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_1` order by key; on instance Executing query SELECT id FROM replicated.mysql_schema_inference_engine on replica1 Executing query SELECT id FROM replicated.mysql_schema_inference_engine on replica1 Executing query create workload D3 in X settings priority = 1; on node Executing query create workload D3 in X settings priority = 1; on node Executing query select * from `test_database`.`postgresql_replica_1` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_1` order by key; on instance Executing query SELECT id FROM replicated.mysql_schema_inference_function on replica1 Executing query SELECT id FROM replicated.mysql_schema_inference_function on replica1 Executing query drop workload A1; on node Executing query drop workload A1; on node Executing query SELECT * FROM `test_database`.`postgresql_replica_2` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_2` LIMIT 1 FORMAT Null on instance Executing query SELECT id FROM replicated.merge_tree on replica1 Executing query SELECT id FROM replicated.merge_tree on replica1 Executing query drop workload B1; on node Executing query drop workload B1; on node http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_2' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_2' on instance http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Executing query CREATE DICTIONARY replicated.dict1 (id INT, data String) PRIMARY KEY id SOURCE(MYSQL(HOST 'mysql80' PORT 3306 USER 'root' PASSWORD 'clickhouse' DB 'clickhouse' TABLE 'inference_table'))LAYOUT(FLAT()) LIFETIME(MIN 0 MAX 10) on replica1 Executing query CREATE DICTIONARY replicated.dict1 (id INT, data String) PRIMARY KEY id SOURCE(MYSQL(HOST 'mysql80' PORT 3306 USER 'root' PASSWORD 'clickhouse' DB 'clickhouse' TABLE 'inference_table'))LAYOUT(FLAT()) LIFETIME(MIN 0 MAX 10) on replica1 Executing query drop workload C1; on node Executing query drop workload C1; on node Executing query select * from `postgres_database`.`postgresql_replica_2` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_2` order by key; on instance Executing query drop workload D1; on node Executing query drop workload D1; on node Executing query CREATE DICTIONARY replicated.dict2 (name String, value UInt32) PRIMARY KEY value SOURCE(CLICKHOUSE(HOST '127.0.0.2' PORT 9000 USER 'default' PASSWORD '' DB 'replicated' TABLE 'example_s3_engine_table'))LAYOUT(FLAT()) LIFETIME(MIN 0 MAX 10) on replica1 Executing query CREATE DICTIONARY replicated.dict2 (name String, value UInt32) PRIMARY KEY value SOURCE(CLICKHOUSE(HOST '127.0.0.2' PORT 9000 USER 'default' PASSWORD '' DB 'replicated' TABLE 'example_s3_engine_table'))LAYOUT(FLAT()) LIFETIME(MIN 0 MAX 10) on replica1 Executing query select * from `test_database`.`postgresql_replica_2` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_2` order by key; on instance Executing query drop workload A2; on node Executing query drop workload A2; on node Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper', 'clickhouse'] Received response(xid=1): ['keeper', 'clickhouse'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo2 get_instance_ip instance_name=zoo2 http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-zoo2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-zoo2-1/json HTTP/1.1" 200 None get_kazoo_client: zoo2, ip:172.16.9.3, port:2181, use_ssl:False get_kazoo_client: zoo2, ip:172.16.9.3, port:2181, use_ssl:False Connecting to 172.16.9.3(172.16.9.3):2181, use_ssl: False Connecting to 172.16.9.3(172.16.9.3):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper', 'clickhouse'] Received response(xid=1): ['keeper', 'clickhouse'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Executing query SELECT * FROM `test_database`.`postgresql_replica_3` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_3` LIMIT 1 FORMAT Null on instance Executing query drop workload B2; on node Executing query drop workload B2; on node Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo3 get_instance_ip instance_name=zoo3 Executing query CREATE DICTIONARY replicated.dict3 (name String, value UInt32) PRIMARY KEY value SOURCE(CLICKHOUSE(USER 'default' PASSWORD '' DB 'replicated' TABLE 'example_s3_engine_table'))LAYOUT(FLAT()) LIFETIME(MIN 0 MAX 10) on replica1 Executing query CREATE DICTIONARY replicated.dict3 (name String, value UInt32) PRIMARY KEY value SOURCE(CLICKHOUSE(USER 'default' PASSWORD '' DB 'replicated' TABLE 'example_s3_engine_table'))LAYOUT(FLAT()) LIFETIME(MIN 0 MAX 10) on replica1 http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-zoo3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-zoo3-1/json HTTP/1.1" 200 None get_kazoo_client: zoo3, ip:172.16.9.4, port:2181, use_ssl:False get_kazoo_client: zoo3, ip:172.16.9.4, port:2181, use_ssl:False Connecting to 172.16.9.4(172.16.9.4):2181, use_ssl: False Connecting to 172.16.9.4(172.16.9.4):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper', 'clickhouse'] Received response(xid=1): ['keeper', 'clickhouse'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED All instances of ZooKeeper started: ['zoo1', 'zoo2', 'zoo3'] All instances of ZooKeeper started: ['zoo1', 'zoo2', 'zoo3'] Executing query SELECT create_query FROM system.functions WHERE name='f1' on node2 Executing query SELECT create_query FROM system.functions WHERE name='f1' on node2 Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_3' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_3' on instance Executing query drop workload C2; on node Executing query drop workload C2; on node http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None Executing query SYSTEM SYNC DATABASE REPLICA replicated on replica2 Executing query SYSTEM SYNC DATABASE REPLICA replicated on replica2 http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Executing query select * from `postgres_database`.`postgresql_replica_3` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_3` order by key; on instance Executing query ALTER TABLE simple2 FETCH PARTITION '2020-08-27' FROM 'zookeeper2:/clickhouse/tables/0/simple'; on node Executing query ALTER TABLE simple2 FETCH PARTITION '2020-08-27' FROM 'zookeeper2:/clickhouse/tables/0/simple'; on node Executing query drop workload D2; on node Executing query drop workload D2; on node Executing query BACKUP DATABASE replicated TO Disk('backups', '1/') on replica2 Executing query BACKUP DATABASE replicated TO Disk('backups', '1/') on replica2 Executing query select * from `test_database`.`postgresql_replica_3` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_3` order by key; on instance Executing query ALTER TABLE simple2 ATTACH PARTITION '2020-08-27'; on node Executing query ALTER TABLE simple2 ATTACH PARTITION '2020-08-27'; on node Executing query drop workload A3; on node Executing query drop workload A3; on node Executing query DROP DICTIONARY IF EXISTS replicated.dict3 SYNC on replica2 Executing query DROP DICTIONARY IF EXISTS replicated.dict3 SYNC on replica2 Executing query SELECT * FROM `test_database`.`postgresql_replica_4` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_4` LIMIT 1 FORMAT Null on instance Executing query SELECT create_query FROM system.functions WHERE name='f1' on node2 Executing query SELECT create_query FROM system.functions WHERE name='f1' on node2 Executing query SELECT id FROM simple2 on node Executing query SELECT id FROM simple2 on node Executing query drop workload B3; on node Executing query drop workload B3; on node Executing query drop workload C3; on node Executing query drop workload C3; on node Executing query DROP DICTIONARY IF EXISTS replicated.dict2 SYNC on replica2 Executing query DROP DICTIONARY IF EXISTS replicated.dict2 SYNC on replica2 Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_4' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_4' on instance run container_id:roottestreloadauxiliaryzookeepers-gw0-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo \'\n \n \n zoo2\n 2181\n \n 2000\n \n\' > /etc/clickhouse-server/conf.d/zookeeper_config.xml'] run container_id:roottestreloadauxiliaryzookeepers-gw0-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo \'\n \n \n zoo2\n 2181\n \n 2000\n \n\' > /etc/clickhouse-server/conf.d/zookeeper_config.xml'] Command:[docker exec roottestreloadauxiliaryzookeepers-gw0-node-1 bash -c echo ' zoo2 2181 2000 ' > /etc/clickhouse-server/conf.d/zookeeper_config.xml] Command:[docker exec roottestreloadauxiliaryzookeepers-gw0-node-1 bash -c echo ' zoo2 2181 2000 ' > /etc/clickhouse-server/conf.d/zookeeper_config.xml] Executing query SYSTEM RELOAD CONFIG on node Executing query SYSTEM RELOAD CONFIG on node Executing query drop workload D3; on node Executing query drop workload D3; on node Executing query select * from `postgres_database`.`postgresql_replica_4` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_4` order by key; on instance Executing query DROP DICTIONARY IF EXISTS replicated.dict1 SYNC on replica2 Executing query DROP DICTIONARY IF EXISTS replicated.dict1 SYNC on replica2 http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Executing query drop workload X; on node Executing query drop workload X; on node Executing query select * from `test_database`.`postgresql_replica_4` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_4` order by key; on instance Executing query DROP TABLE replicated.example_s3_engine_table on replica2 Executing query DROP TABLE replicated.example_s3_engine_table on replica2 Executing query SELECT create_query FROM system.functions WHERE name='f1' on node2 Executing query SELECT create_query FROM system.functions WHERE name='f1' on node2 Executing query drop workload Y; on node Executing query drop workload Y; on node Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Executing query DROP TABLE replicated.mysql_schema_inference_engine on replica2 Executing query DROP TABLE replicated.mysql_schema_inference_engine on replica2 Executing query DROP FUNCTION f1 on node1 Executing query DROP FUNCTION f1 on node1 Executing query drop workload Z; on node Executing query drop workload Z; on node Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance Executing query DROP TABLE replicated.mysql_schema_inference_function on replica2 Executing query DROP TABLE replicated.mysql_schema_inference_function on replica2 Executing query drop workload all; on node Executing query drop workload all; on node Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --project-name roottestreplicateduserdefinedfunctions-gw2 --file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node2/docker-compose.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --project-name roottestreplicateduserdefinedfunctions-gw2 --file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node2/docker-compose.yml stop --timeout 20] [gw2] PASSED test_replicated_user_defined_functions/test.py::test_start_without_zookeeper Executing query select * from `postgres_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_0` order by key; on instance http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/dbdfef9b01cd2a5dbc5758b253a2d94e3ed5e1f7bbadb6b0bb6e44a4d37d2a15/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/dbdfef9b01cd2a5dbc5758b253a2d94e3ed5e1f7bbadb6b0bb6e44a4d37d2a15/start HTTP/1.1" 101 0 Executing query SYSTEM SYNC DATABASE REPLICA replicated on replica3 Executing query SYSTEM SYNC DATABASE REPLICA replicated on replica3 http://localhost:None "GET /v1.46/exec/dbdfef9b01cd2a5dbc5758b253a2d94e3ed5e1f7bbadb6b0bb6e44a4d37d2a15/json HTTP/1.1" 200 456 http://localhost:None "GET /v1.46/exec/dbdfef9b01cd2a5dbc5758b253a2d94e3ed5e1f7bbadb6b0bb6e44a4d37d2a15/json HTTP/1.1" 200 456 [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-d', '172.16.8.9', '--sport', '2181', '-j', 'DROP'] (0): [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-d', '172.16.8.9', '--sport', '2181', '-j', 'DROP'] (0): http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/f60bb7ee044d4eb675b4fd6a5da15890ea62419a94da6c1bd629de85e61c8b92/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/f60bb7ee044d4eb675b4fd6a5da15890ea62419a94da6c1bd629de85e61c8b92/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/exec/f60bb7ee044d4eb675b4fd6a5da15890ea62419a94da6c1bd629de85e61c8b92/json HTTP/1.1" 200 456 http://localhost:None "GET /v1.46/exec/f60bb7ee044d4eb675b4fd6a5da15890ea62419a94da6c1bd629de85e61c8b92/json HTTP/1.1" 200 456 [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-s', '172.16.8.9', '--dport', '2181', '-j', 'DROP'] (0): [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-s', '172.16.8.9', '--dport', '2181', '-j', 'DROP'] (0): Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 Executing query EXISTS replicated.mysql_schema_inference_engine on replica3 Executing query EXISTS replicated.mysql_schema_inference_engine on replica3 Executing query SELECT * FROM `test_database`.`postgresql_replica_1` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_1` LIMIT 1 FORMAT Null on instance Executing query EXISTS replicated.mysql_schema_inference_function on replica3 Executing query EXISTS replicated.mysql_schema_inference_function on replica3 Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_1' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_1' on instance Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node Executing query RESTORE DATABASE replicated FROM Disk('backups', '1/') SETTINGS allow_different_database_def=true on replica3 Executing query RESTORE DATABASE replicated FROM Disk('backups', '1/') SETTINGS allow_different_database_def=true on replica3 Executing query select * from `postgres_database`.`postgresql_replica_1` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_1` order by key; on instance Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 Executing query select * from `test_database`.`postgresql_replica_1` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_1` order by key; on instance [gw6] PASSED test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3] test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver] Executing query CREATE TABLE s3_test ( id Int64, data String ) ENGINE=MergeTree() ORDER BY id SETTINGS storage_policy='s3_with_resolver' on node Executing query CREATE TABLE s3_test ( id Int64, data String ) ENGINE=MergeTree() ORDER BY id SETTINGS storage_policy='s3_with_resolver' on node Executing query SYSTEM SYNC DATABASE REPLICA replicated on replica1 Executing query SYSTEM SYNC DATABASE REPLICA replicated on replica1 Executing query SELECT * FROM `test_database`.`postgresql_replica_2` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_2` LIMIT 1 FORMAT Null on instance Executing query select name, create_query from system.resources order by all on node Executing query select name, create_query from system.resources order by all on node Executing query INSERT INTO s3_test VALUES (0,'data'),(1,'data') on node Executing query INSERT INTO s3_test VALUES (0,'data'),(1,'data') on node Executing query SELECT engine FROM system.tables where database = 'replicated' and name = 'example_s3_engine_table' on replica1 Executing query SELECT engine FROM system.tables where database = 'replicated' and name = 'example_s3_engine_table' on replica1 Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_2' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_2' on instance Executing query select name, create_query from system.resources order by all on node2 Executing query select name, create_query from system.resources order by all on node2 Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node1-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node1-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node2-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node2-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node1-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node1-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node2-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node2-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Executing query SELECT * FROM s3_test order by id FORMAT Values on node Executing query SELECT * FROM s3_test order by id FORMAT Values on node Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --project-name roottestreplicateduserdefinedfunctions-gw2 --file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node2/docker-compose.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --project-name roottestreplicateduserdefinedfunctions-gw2 --file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node2/docker-compose.yml down --volumes] Executing query select * from `postgres_database`.`postgresql_replica_2` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_2` order by key; on instance Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node Executing query SELECT count(), sum(id) FROM replicated.mysql_schema_inference_engine on replica1 Executing query SELECT count(), sum(id) FROM replicated.mysql_schema_inference_engine on replica1 Executing query DROP TABLE IF EXISTS s3_test SYNC on node Executing query DROP TABLE IF EXISTS s3_test SYNC on node Executing query select * from `test_database`.`postgresql_replica_2` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_2` order by key; on instance Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node2 Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node2 http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None Executing query SELECT count(), sum(id) FROM replicated.mysql_schema_inference_function on replica1 Executing query SELECT count(), sum(id) FROM replicated.mysql_schema_inference_function on replica1 http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Executing query SELECT * FROM `test_database`.`postgresql_replica_3` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_3` LIMIT 1 FORMAT Null on instance http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/290cd7f3675100b0ba9dc32e27888984cb91eba3c785719cf8be89078c25c6c9/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/290cd7f3675100b0ba9dc32e27888984cb91eba3c785719cf8be89078c25c6c9/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/exec/290cd7f3675100b0ba9dc32e27888984cb91eba3c785719cf8be89078c25c6c9/json HTTP/1.1" 200 460 http://localhost:None "GET /v1.46/exec/290cd7f3675100b0ba9dc32e27888984cb91eba3c785719cf8be89078c25c6c9/json HTTP/1.1" 200 460 [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-s', '172.16.8.9', '--dport', '2181', '-j', 'DROP'] (0): [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-s', '172.16.8.9', '--dport', '2181', '-j', 'DROP'] (0): http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/b7967c9e60fcce078683bc6006a3eaec9d937359ef946bfed406c0f1f5c0f192/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/b7967c9e60fcce078683bc6006a3eaec9d937359ef946bfed406c0f1f5c0f192/start HTTP/1.1" 101 0 Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_3' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_3' on instance Executing query SELECT count(), sum(id) FROM replicated.merge_tree on replica1 Executing query SELECT count(), sum(id) FROM replicated.merge_tree on replica1 http://localhost:None "GET /v1.46/exec/b7967c9e60fcce078683bc6006a3eaec9d937359ef946bfed406c0f1f5c0f192/json HTTP/1.1" 200 460 http://localhost:None "GET /v1.46/exec/b7967c9e60fcce078683bc6006a3eaec9d937359ef946bfed406c0f1f5c0f192/json HTTP/1.1" 200 460 [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-d', '172.16.8.9', '--sport', '2181', '-j', 'DROP'] (0): [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-d', '172.16.8.9', '--sport', '2181', '-j', 'DROP'] (0): Executing query create workload all; on node Executing query create workload all; on node Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node1-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node1-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node2-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node2-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node1-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node1-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node1-1 Removing Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node1-1 Removing Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node2-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node2-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node2-1 Removing Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node2-1 Removing Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node1-1 Removed Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node1-1 Removed Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node2-1 Removed Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node2-1 Removed Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Removing Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Removing Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Removing Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Removing Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Removing Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Removing Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Removed Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Removed Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Removed Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Removed Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Removed Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Removed Stderr: Network roottestreplicateduserdefinedfunctions-gw2_default Removing Stderr: Network roottestreplicateduserdefinedfunctions-gw2_default Removing Stderr: Network roottestreplicateduserdefinedfunctions-gw2_default Removed Stderr: Network roottestreplicateduserdefinedfunctions-gw2_default Removed Cleanup called Cleanup called Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node2-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node2-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node1-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node1-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-resolver-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-resolver-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node3-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node3-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node3-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node3-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node1-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node1-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-minio1-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-minio1-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node2-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node2-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo3-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo3-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo2-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo2-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo1-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo1-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-minio1-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-minio1-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo1-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo1-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo2-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo2-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-resolver-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-resolver-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-proxy2-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-proxy2-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-proxy1-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-proxy1-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-proxy2-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-proxy2-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-proxy1-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-proxy1-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo3-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo3-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Docker networks for project roottestreplicateduserdefinedfunctions-gw2 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicateduserdefinedfunctions-gw2 are NETWORK ID NAME DRIVER SCOPE Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node3/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node3/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node3/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node3/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/.env --project-name roottestreplicatedmergetrees3zerocopy-gw5 --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node3/docker-compose.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/.env --project-name roottestreplicatedmergetrees3zerocopy-gw5 --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw5/node3/docker-compose.yml down --volumes] Docker containers for project roottestreplicateduserdefinedfunctions-gw2 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicateduserdefinedfunctions-gw2 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreplicateduserdefinedfunctions-gw2 are DRIVER VOLUME NAME Docker volumes for project roottestreplicateduserdefinedfunctions-gw2 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestreplicateduserdefinedfunctions-gw2-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestreplicateduserdefinedfunctions-gw2-.*-1$' --format '{{.ID}}:{{.Names}}'] Executing query create workload X in all settings priority = 0; on node Executing query create workload X in all settings priority = 0; on node Executing query select * from `postgres_database`.`postgresql_replica_3` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_3` order by key; on instance Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestreplicateduserdefinedfunctions-gw2 No running containers for project: roottestreplicateduserdefinedfunctions-gw2 Trying to prune unused networks... Trying to prune unused networks... Executing query DROP DATABASE IF EXISTS replicated SYNC on replica1 Executing query DROP DATABASE IF EXISTS replicated SYNC on replica1 Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:14 Stdout:14 Command:[docker volume prune -f] Command:[docker volume prune -f] Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 14 Volumes pruned: 14 test_settings_constraints_distributed/test.py::test_insert_clamps_settings Running tests in /ClickHouse/tests/integration/test_settings_constraints_distributed/test.py Running tests in /ClickHouse/tests/integration/test_settings_constraints_distributed/test.py Cluster start called. is_up=False Cluster start called. is_up=False Docker networks for project roottestsettingsconstraintsdistributed-gw2 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestsettingsconstraintsdistributed-gw2 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestsettingsconstraintsdistributed-gw2 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestsettingsconstraintsdistributed-gw2 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestsettingsconstraintsdistributed-gw2 are DRIVER VOLUME NAME Docker volumes for project roottestsettingsconstraintsdistributed-gw2 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker networks for project roottestsettingsconstraintsdistributed-gw2 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestsettingsconstraintsdistributed-gw2 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestsettingsconstraintsdistributed-gw2 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestsettingsconstraintsdistributed-gw2 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Executing query create workload Y in all settings priority = 1; on node Executing query create workload Y in all settings priority = 1; on node Executing query select * from `test_database`.`postgresql_replica_3` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_3` order by key; on instance Docker volumes for project roottestsettingsconstraintsdistributed-gw2 are DRIVER VOLUME NAME Docker volumes for project roottestsettingsconstraintsdistributed-gw2 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestsettingsconstraintsdistributed-gw2-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestsettingsconstraintsdistributed-gw2-.*-1$' --format '{{.ID}}:{{.Names}}'] Executing query DROP DATABASE IF EXISTS replicated SYNC on replica2 Executing query DROP DATABASE IF EXISTS replicated SYNC on replica2 Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestsettingsconstraintsdistributed-gw2 No running containers for project: roottestsettingsconstraintsdistributed-gw2 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:12 Stdout:12 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 12 Volumes pruned: 12 Setup directory for instance: node1 Setup directory for instance: node1 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_settings_constraints_distributed/configs/config.d/remote_servers.xml'] to /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node1/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_settings_constraints_distributed/configs/config.d/remote_servers.xml'] to /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node1/configs/config.d Setup database dir /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node1/database Setup database dir /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node1/database Setup logs dir /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node1/logs Setup logs dir /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node1/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Setup directory for instance: node2 Setup directory for instance: node2 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_settings_constraints_distributed/configs/config.d/remote_servers.xml'] to /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node2/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_settings_constraints_distributed/configs/config.d/remote_servers.xml'] to /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node2/configs/config.d Setup database dir /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node2/database Setup database dir /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node2/database Setup logs dir /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node2/logs Setup logs dir /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node2/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Setup directory for instance: distributed Setup directory for instance: distributed Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_settings_constraints_distributed/configs/config.d/remote_servers.xml'] to /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/distributed/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_settings_constraints_distributed/configs/config.d/remote_servers.xml'] to /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/distributed/configs/config.d Setup database dir /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/distributed/database Setup database dir /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/distributed/database Setup logs dir /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/distributed/logs Setup logs dir /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/distributed/logs Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw'} stored in /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw'} stored in /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/.env --project-name roottestsettingsconstraintsdistributed-gw2 --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/distributed/docker-compose.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/.env --project-name roottestsettingsconstraintsdistributed-gw2 --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/distributed/docker-compose.yml pull] Executing query create workload A1 in X settings priority = -1; on node Executing query create workload A1 in X settings priority = -1; on node Executing query SELECT * FROM `test_database`.`postgresql_replica_4` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_4` LIMIT 1 FORMAT Null on instance Executing query DROP DATABASE IF EXISTS replicated SYNC on replica3 Executing query DROP DATABASE IF EXISTS replicated SYNC on replica3 http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Executing query create workload B1 in X settings priority = 1; on node Executing query create workload B1 in X settings priority = 1; on node Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_4' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_4' on instance Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node3-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node3-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node1-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node1-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-resolver-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-resolver-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node2-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node2-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node3-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node3-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node3-1 Removing Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node3-1 Removing Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-resolver-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-resolver-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-resolver-1 Removing Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-resolver-1 Removing Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node1-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node1-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node1-1 Removing Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node1-1 Removing Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node2-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node2-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node2-1 Removing Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node2-1 Removing Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node3-1 Removed Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node3-1 Removed Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-resolver-1 Removed Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-resolver-1 Removed Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node1-1 Removed Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node1-1 Removed Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-minio1-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-minio1-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node2-1 Removed Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-node2-1 Removed Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo2-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo2-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo3-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo3-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo1-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo1-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-minio1-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-minio1-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-minio1-1 Removing Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-minio1-1 Removing Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo1-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo1-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo1-1 Removing Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo1-1 Removing Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo3-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo3-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo3-1 Removing Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo3-1 Removing Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo2-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo2-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo2-1 Removing Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo2-1 Removing Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo3-1 Removed Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo3-1 Removed Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo1-1 Removed Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo1-1 Removed Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo2-1 Removed Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-zoo2-1 Removed Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-minio1-1 Removed Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-minio1-1 Removed Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-proxy1-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-proxy1-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-proxy2-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-proxy2-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-proxy2-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-proxy2-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-proxy2-1 Removing Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-proxy2-1 Removing Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-proxy1-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-proxy1-1 Stopped [gw9] Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-proxy1-1 Removing Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-proxy1-1 Removing Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-proxy2-1 Removed Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-proxy2-1 Removed PASSED test_restore_external_engines/test.py::test_restore_table Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-proxy1-1 Removed Stderr: Container roottestreplicatedmergetrees3zerocopy-gw5-proxy1-1 Removed Stderr: Volume roottestreplicatedmergetrees3zerocopy-gw5_data1-1 Removing Stderr: Volume roottestreplicatedmergetrees3zerocopy-gw5_data1-1 Removing Stderr: Network roottestreplicatedmergetrees3zerocopy-gw5_default Removing Stderr: Network roottestreplicatedmergetrees3zerocopy-gw5_default Removing Stderr: Volume roottestreplicatedmergetrees3zerocopy-gw5_data1-1 Removed Stderr: Volume roottestreplicatedmergetrees3zerocopy-gw5_data1-1 Removed Stderr: Network roottestreplicatedmergetrees3zerocopy-gw5_default Removed Stderr: Network roottestreplicatedmergetrees3zerocopy-gw5_default Removed Cleanup called Cleanup called Executing query DROP DATABASE IF EXISTS replicated2 SYNC on replica1 Executing query DROP DATABASE IF EXISTS replicated2 SYNC on replica1 test_restore_external_engines/test.py::test_restore_table_null Docker networks for project roottestreplicatedmergetrees3zerocopy-gw5 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicatedmergetrees3zerocopy-gw5 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestreplicatedmergetrees3zerocopy-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicatedmergetrees3zerocopy-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreplicatedmergetrees3zerocopy-gw5 are DRIVER VOLUME NAME Docker volumes for project roottestreplicatedmergetrees3zerocopy-gw5 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestreplicatedmergetrees3zerocopy-gw5-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestreplicatedmergetrees3zerocopy-gw5-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestreplicatedmergetrees3zerocopy-gw5 No running containers for project: roottestreplicatedmergetrees3zerocopy-gw5 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:12 Stdout:12 Command:[docker volume prune -f] Command:[docker volume prune -f] Executing query create workload C1 in Y settings priority = -1; on node Executing query create workload C1 in Y settings priority = -1; on node Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 12 Volumes pruned: 12 test_replicated_merge_tree_compatibility/test.py::test_replicated_merge_tree_defaults_compatibility Running tests in /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/test.py Running tests in /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/test.py Cluster start called. is_up=False Cluster start called. is_up=False Executing query select * from `postgres_database`.`postgresql_replica_4` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_4` order by key; on instance Docker networks for project roottestreplicatedmergetreecompatibility-gw5 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicatedmergetreecompatibility-gw5 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestreplicatedmergetreecompatibility-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicatedmergetreecompatibility-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreplicatedmergetreecompatibility-gw5 are DRIVER VOLUME NAME Docker volumes for project roottestreplicatedmergetreecompatibility-gw5 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker networks for project roottestreplicatedmergetreecompatibility-gw5 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicatedmergetreecompatibility-gw5 are NETWORK ID NAME DRIVER SCOPE Executing query DROP DATABASE IF EXISTS replicated2 SYNC on replica2 Executing query DROP DATABASE IF EXISTS replicated2 SYNC on replica2 Docker containers for project roottestreplicatedmergetreecompatibility-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicatedmergetreecompatibility-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreplicatedmergetreecompatibility-gw5 are DRIVER VOLUME NAME Docker volumes for project roottestreplicatedmergetreecompatibility-gw5 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestreplicatedmergetreecompatibility-gw5-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestreplicatedmergetreecompatibility-gw5-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestreplicatedmergetreecompatibility-gw5 No running containers for project: roottestreplicatedmergetreecompatibility-gw5 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:12 Stdout:12 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 12 Volumes pruned: 12 Setup directory for instance: node1 Setup directory for instance: node1 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files [] to /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/node1/configs/config.d Copy custom test config files [] to /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/node1/configs/config.d Setup database dir /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/node1/database Setup database dir /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/node1/database Setup logs dir /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/node1/logs Setup logs dir /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/node1/logs Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" Setup directory for instance: node2 Setup directory for instance: node2 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files [] to /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/node2/configs/config.d Copy custom test config files [] to /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/node2/configs/config.d Setup database dir /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/node2/database Setup database dir /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/node2/database Setup logs dir /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/node2/logs Setup logs dir /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/node2/logs Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/keeper3/coordination'} stored in /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/keeper3/coordination'} stored in /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Executing query create workload D1 in Y settings priority = 1; on node Executing query create workload D1 in Y settings priority = 1; on node http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/.env --project-name roottestreplicatedmergetreecompatibility-gw5 --file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/node2/docker-compose.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/.env --project-name roottestreplicatedmergetreecompatibility-gw5 --file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/node2/docker-compose.yml pull] Executing query select * from `test_database`.`postgresql_replica_4` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_4` order by key; on instance Executing query DROP DATABASE IF EXISTS replicated2 SYNC on replica3 Executing query DROP DATABASE IF EXISTS replicated2 SYNC on replica3 Executing query ALTER TABLE simple2 FETCH PARTITION '2020-08-27' FROM 'zookeeper2:/clickhouse/tables/0/simple'; on node Executing query ALTER TABLE simple2 FETCH PARTITION '2020-08-27' FROM 'zookeeper2:/clickhouse/tables/0/simple'; on node Executing query CREATE DATABASE replicated2 ENGINE = Replicated('/clickhouse/databases/replicated2', 'default', 'replica1') on replica1 Executing query CREATE DATABASE replicated2 ENGINE = Replicated('/clickhouse/databases/replicated2', 'default', 'replica1') on replica1 Executing query create workload A2 in X settings priority = -1; on node Executing query create workload A2 in X settings priority = -1; on node Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Executing query SELECT id FROM simple2 on node Executing query SELECT id FROM simple2 on node Executing query CREATE DATABASE replicated2 ENGINE = Replicated('/clickhouse/databases/replicated2', 'default', 'replica2') on replica2 Executing query CREATE DATABASE replicated2 ENGINE = Replicated('/clickhouse/databases/replicated2', 'default', 'replica2') on replica2 Executing query create workload B2 in X settings priority = 1; on node Executing query create workload B2 in X settings priority = 1; on node Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Executing query create workload C2 in Y settings priority = -1; on node Executing query create workload C2 in Y settings priority = -1; on node Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/.env --project-name roottestreloadauxiliaryzookeepers-gw0 --file /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/.env --project-name roottestreloadauxiliaryzookeepers-gw0 --file /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop --timeout 20] [gw0] PASSED test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers Executing query CREATE DATABASE replicated2 ENGINE = Replicated('/clickhouse/databases/replicated2', 'default', 'replica3') on replica3 Executing query CREATE DATABASE replicated2 ENGINE = Replicated('/clickhouse/databases/replicated2', 'default', 'replica3') on replica3 Executing query select * from `postgres_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_0` order by key; on instance Executing query create workload D2 in Y settings priority = 1; on node Executing query create workload D2 in Y settings priority = 1; on node Executing query CREATE TABLE replicated2.example_s3_engine_table (name String, value UInt32) ENGINE = S3('https://clickhouse-public-datasets.s3.amazonaws.com/my-test-bucket-768/test-data.csv.gz', 'CSV', 'gzip') SETTINGS input_format_with_names_use_header = 0 on replica1 Executing query CREATE TABLE replicated2.example_s3_engine_table (name String, value UInt32) ENGINE = S3('https://clickhouse-public-datasets.s3.amazonaws.com/my-test-bucket-768/test-data.csv.gz', 'CSV', 'gzip') SETTINGS input_format_with_names_use_header = 0 on replica1 Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query drop workload A1; on node Executing query drop workload A1; on node Executing query CREATE TABLE replicated2.mysql_schema_inference_engine ENGINE=MySQL('mysql80:3306', 'clickhouse', 'inference_table', 'root', 'clickhouse') on replica1 Executing query CREATE TABLE replicated2.mysql_schema_inference_engine ENGINE=MySQL('mysql80:3306', 'clickhouse', 'inference_table', 'root', 'clickhouse') on replica1 Executing query drop workload A2; on node Executing query drop workload A2; on node http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/57534663c8feeeb74d8622c7bc4b6520bf10092b9ebb9758b8729af5369ccb94/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/57534663c8feeeb74d8622c7bc4b6520bf10092b9ebb9758b8729af5369ccb94/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None Executing query CREATE TABLE replicated2.mysql_schema_inference_function AS mysql('mysql80:3306', 'clickhouse', 'inference_table', 'root', 'clickhouse') on replica1 Executing query CREATE TABLE replicated2.mysql_schema_inference_function AS mysql('mysql80:3306', 'clickhouse', 'inference_table', 'root', 'clickhouse') on replica1 http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/exec/57534663c8feeeb74d8622c7bc4b6520bf10092b9ebb9758b8729af5369ccb94/json HTTP/1.1" 200 456 http://localhost:None "GET /v1.46/exec/57534663c8feeeb74d8622c7bc4b6520bf10092b9ebb9758b8729af5369ccb94/json HTTP/1.1" 200 456 [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-d', '172.16.8.9', '--sport', '2181', '-j', 'DROP'] (0): [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-d', '172.16.8.9', '--sport', '2181', '-j', 'DROP'] (0): http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/c616770b69b1a29e0b012a1657398bd2b5d0357267dab60c085f94b029bd1d60/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/c616770b69b1a29e0b012a1657398bd2b5d0357267dab60c085f94b029bd1d60/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/exec/c616770b69b1a29e0b012a1657398bd2b5d0357267dab60c085f94b029bd1d60/json HTTP/1.1" 200 456 http://localhost:None "GET /v1.46/exec/c616770b69b1a29e0b012a1657398bd2b5d0357267dab60c085f94b029bd1d60/json HTTP/1.1" 200 456 [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-s', '172.16.8.9', '--dport', '2181', '-j', 'DROP'] (0): [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-s', '172.16.8.9', '--dport', '2181', '-j', 'DROP'] (0): Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node Executing query CREATE TABLE replicated2.merge_tree (id UInt64, b String) ORDER BY id on replica1 Executing query CREATE TABLE replicated2.merge_tree (id UInt64, b String) ORDER BY id on replica1 Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query INSERT INTO replicated2.merge_tree VALUES (100, 'abc') on replica1 Executing query INSERT INTO replicated2.merge_tree VALUES (100, 'abc') on replica1 Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node Executing query DESCRIBE TABLE replicated2.mysql_schema_inference_engine on replica1 Executing query DESCRIBE TABLE replicated2.mysql_schema_inference_engine on replica1 Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Executing query DESCRIBE TABLE replicated2.mysql_schema_inference_function on replica1 Executing query DESCRIBE TABLE replicated2.mysql_schema_inference_function on replica1 Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node Executing query SELECT id FROM mysql('mysql80:3306', 'clickhouse', 'inference_table', 'root', 'clickhouse') on replica1 Executing query SELECT id FROM mysql('mysql80:3306', 'clickhouse', 'inference_table', 'root', 'clickhouse') on replica1 Executing query SELECT id FROM replicated2.mysql_schema_inference_engine on replica1 Executing query SELECT id FROM replicated2.mysql_schema_inference_engine on replica1 Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 Executing query SELECT id FROM replicated2.mysql_schema_inference_function on replica1 Executing query SELECT id FROM replicated2.mysql_schema_inference_function on replica1 Executing query select name, create_query from system.resources order by all on node Executing query select name, create_query from system.resources order by all on node Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query select name, create_query from system.resources order by all on node2 Executing query select name, create_query from system.resources order by all on node2 Executing query SELECT id FROM replicated2.merge_tree on replica1 Executing query SELECT id FROM replicated2.merge_tree on replica1 http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node Executing query CREATE DICTIONARY replicated2.dict1 (id INT, data String) PRIMARY KEY id SOURCE(MYSQL(HOST 'mysql80' PORT 3306 USER 'root' PASSWORD 'clickhouse' DB 'clickhouse' TABLE 'inference_table'))LAYOUT(FLAT()) LIFETIME(MIN 0 MAX 10) on replica1 Executing query CREATE DICTIONARY replicated2.dict1 (id INT, data String) PRIMARY KEY id SOURCE(MYSQL(HOST 'mysql80' PORT 3306 USER 'root' PASSWORD 'clickhouse' DB 'clickhouse' TABLE 'inference_table'))LAYOUT(FLAT()) LIFETIME(MIN 0 MAX 10) on replica1 Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node2 Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node2 Executing query CREATE DICTIONARY replicated2.dict2 (name String, value UInt32) PRIMARY KEY value SOURCE(CLICKHOUSE(HOST '127.0.0.2' PORT 9000 USER 'default' PASSWORD '' DB 'replicated2' TABLE 'example_s3_engine_table'))LAYOUT(FLAT()) LIFETIME(MIN 0 MAX 10) on replica1 Executing query CREATE DICTIONARY replicated2.dict2 (name String, value UInt32) PRIMARY KEY value SOURCE(CLICKHOUSE(HOST '127.0.0.2' PORT 9000 USER 'default' PASSWORD '' DB 'replicated2' TABLE 'example_s3_engine_table'))LAYOUT(FLAT()) LIFETIME(MIN 0 MAX 10) on replica1 http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/f2d2afe9b7a10dc47c302ddc7744c2ff3733656775b10bb44f5bd841a55f8593/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/f2d2afe9b7a10dc47c302ddc7744c2ff3733656775b10bb44f5bd841a55f8593/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/exec/f2d2afe9b7a10dc47c302ddc7744c2ff3733656775b10bb44f5bd841a55f8593/json HTTP/1.1" 200 460 http://localhost:None "GET /v1.46/exec/f2d2afe9b7a10dc47c302ddc7744c2ff3733656775b10bb44f5bd841a55f8593/json HTTP/1.1" 200 460 [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-s', '172.16.8.9', '--dport', '2181', '-j', 'DROP'] (0): [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-s', '172.16.8.9', '--dport', '2181', '-j', 'DROP'] (0): http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/85a9aa46ff71f99689033abcb3062d6b2d03e0d928786282fb547fc2f4c440d2/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/85a9aa46ff71f99689033abcb3062d6b2d03e0d928786282fb547fc2f4c440d2/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/exec/85a9aa46ff71f99689033abcb3062d6b2d03e0d928786282fb547fc2f4c440d2/json HTTP/1.1" 200 460 http://localhost:None "GET /v1.46/exec/85a9aa46ff71f99689033abcb3062d6b2d03e0d928786282fb547fc2f4c440d2/json HTTP/1.1" 200 460 [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-d', '172.16.8.9', '--sport', '2181', '-j', 'DROP'] (0): [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-d', '172.16.8.9', '--sport', '2181', '-j', 'DROP'] (0): Executing query drop workload B1; on node Executing query drop workload B1; on node Executing query CREATE DICTIONARY replicated2.dict3 (name String, value UInt32) PRIMARY KEY value SOURCE(CLICKHOUSE(USER 'default' PASSWORD '' DB 'replicated2' TABLE 'example_s3_engine_table'))LAYOUT(FLAT()) LIFETIME(MIN 0 MAX 10) on replica1 Executing query CREATE DICTIONARY replicated2.dict3 (name String, value UInt32) PRIMARY KEY value SOURCE(CLICKHOUSE(USER 'default' PASSWORD '' DB 'replicated2' TABLE 'example_s3_engine_table'))LAYOUT(FLAT()) LIFETIME(MIN 0 MAX 10) on replica1 Executing query drop workload B2; on node Executing query drop workload B2; on node Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query SYSTEM SYNC DATABASE REPLICA replicated2 on replica2 Executing query SYSTEM SYNC DATABASE REPLICA replicated2 on replica2 http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None Executing query drop workload C1; on node Executing query drop workload C1; on node http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Executing query SELECT * FROM `test_database`.`postgresql_replica_1` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_1` LIMIT 1 FORMAT Null on instance Executing query BACKUP DATABASE replicated2 TO Disk('backups', '2/') on replica2 Executing query BACKUP DATABASE replicated2 TO Disk('backups', '2/') on replica2 Executing query drop workload C2; on node Executing query drop workload C2; on node Executing query drop workload D1; on node Executing query drop workload D1; on node Executing query DROP DICTIONARY IF EXISTS replicated2.dict3 SYNC on replica2 Executing query DROP DICTIONARY IF EXISTS replicated2.dict3 SYNC on replica2 Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_1' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_1' on instance Executing query drop workload D2; on node Executing query drop workload D2; on node Executing query select * from `postgres_database`.`postgresql_replica_1` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_1` order by key; on instance Executing query DROP DICTIONARY IF EXISTS replicated2.dict2 SYNC on replica2 Executing query DROP DICTIONARY IF EXISTS replicated2.dict2 SYNC on replica2 http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Executing query create workload Z in all; on node Executing query create workload Z in all; on node http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Executing query DROP DICTIONARY IF EXISTS replicated2.dict1 SYNC on replica2 Executing query DROP DICTIONARY IF EXISTS replicated2.dict1 SYNC on replica2 Executing query select * from `test_database`.`postgresql_replica_1` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_1` order by key; on instance Executing query create workload A1 in Z settings priority = -1; on node Executing query create workload A1 in Z settings priority = -1; on node Executing query DROP TABLE replicated2.example_s3_engine_table on replica2 Executing query DROP TABLE replicated2.example_s3_engine_table on replica2 Executing query SELECT * FROM `test_database`.`postgresql_replica_2` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_2` LIMIT 1 FORMAT Null on instance Stderr: Container roottestreloadauxiliaryzookeepers-gw0-node-1 Stopping Stderr: Container roottestreloadauxiliaryzookeepers-gw0-node-1 Stopping Stderr: Container roottestreloadauxiliaryzookeepers-gw0-node-1 Stopped Stderr: Container roottestreloadauxiliaryzookeepers-gw0-node-1 Stopped Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo3-1 Stopping Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo3-1 Stopping Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo1-1 Stopping Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo1-1 Stopping Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo2-1 Stopping Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo2-1 Stopping Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo2-1 Stopped Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo2-1 Stopped Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo3-1 Stopped Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo3-1 Stopped Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo1-1 Stopped Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo1-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/.env --project-name roottestreloadauxiliaryzookeepers-gw0 --file /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/.env --project-name roottestreloadauxiliaryzookeepers-gw0 --file /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw0/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml down --volumes] Executing query create workload A2 in Z settings priority = -1; on node Executing query create workload A2 in Z settings priority = -1; on node Executing query DROP TABLE replicated2.mysql_schema_inference_engine on replica2 Executing query DROP TABLE replicated2.mysql_schema_inference_engine on replica2 Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_2' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_2' on instance Executing query create workload A3 in Z settings priority = -1; on node Executing query create workload A3 in Z settings priority = -1; on node Executing query select * from `postgres_database`.`postgresql_replica_2` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_2` order by key; on instance Executing query DROP TABLE replicated2.mysql_schema_inference_function on replica2 Executing query DROP TABLE replicated2.mysql_schema_inference_function on replica2 Executing query create workload B1 in Z settings priority = 1; on node Executing query create workload B1 in Z settings priority = 1; on node Executing query select * from `test_database`.`postgresql_replica_2` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_2` order by key; on instance Executing query SYSTEM SYNC DATABASE REPLICA replicated2 on replica3 Executing query SYSTEM SYNC DATABASE REPLICA replicated2 on replica3 http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Stderr: Container roottestreloadauxiliaryzookeepers-gw0-node-1 Stopping Stderr: Container roottestreloadauxiliaryzookeepers-gw0-node-1 Stopping Stderr: Container roottestreloadauxiliaryzookeepers-gw0-node-1 Stopped Stderr: Container roottestreloadauxiliaryzookeepers-gw0-node-1 Stopped Stderr: Container roottestreloadauxiliaryzookeepers-gw0-node-1 Removing Stderr: Container roottestreloadauxiliaryzookeepers-gw0-node-1 Removing Stderr: Container roottestreloadauxiliaryzookeepers-gw0-node-1 Removed Stderr: Container roottestreloadauxiliaryzookeepers-gw0-node-1 Removed Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo1-1 Stopping Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo1-1 Stopping Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo2-1 Stopping Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo2-1 Stopping Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo3-1 Stopping Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo3-1 Stopping Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo1-1 Stopped Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo1-1 Stopped Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo1-1 Removing Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo1-1 Removing Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo2-1 Stopped Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo2-1 Stopped Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo2-1 Removing Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo2-1 Removing Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo3-1 Stopped Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo3-1 Stopped Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo3-1 Removing Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo3-1 Removing Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo3-1 Removed Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo3-1 Removed Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo2-1 Removed Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo2-1 Removed Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo1-1 Removed Stderr: Container roottestreloadauxiliaryzookeepers-gw0-zoo1-1 Removed Stderr: Network roottestreloadauxiliaryzookeepers-gw0_default Removing Stderr: Network roottestreloadauxiliaryzookeepers-gw0_default Removing Stderr: Network roottestreloadauxiliaryzookeepers-gw0_default Removed Stderr: Network roottestreloadauxiliaryzookeepers-gw0_default Removed Cleanup called Cleanup called Docker networks for project roottestreloadauxiliaryzookeepers-gw0 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreloadauxiliaryzookeepers-gw0 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestreloadauxiliaryzookeepers-gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreloadauxiliaryzookeepers-gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreloadauxiliaryzookeepers-gw0 are DRIVER VOLUME NAME Docker volumes for project roottestreloadauxiliaryzookeepers-gw0 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestreloadauxiliaryzookeepers-gw0-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestreloadauxiliaryzookeepers-gw0-.*-1$' --format '{{.ID}}:{{.Names}}'] Executing query create workload B2 in Z settings priority = 1; on node Executing query create workload B2 in Z settings priority = 1; on node Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestreloadauxiliaryzookeepers-gw0 No running containers for project: roottestreloadauxiliaryzookeepers-gw0 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Executing query EXISTS replicated2.mysql_schema_inference_engine on replica3 Executing query EXISTS replicated2.mysql_schema_inference_engine on replica3 Executing query SELECT * FROM `test_database`.`postgresql_replica_3` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_3` LIMIT 1 FORMAT Null on instance Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:12 Stdout:12 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 12 Volumes pruned: 12 test_remote_prewhere/test.py::test_remote Running tests in /ClickHouse/tests/integration/test_remote_prewhere/test.py Running tests in /ClickHouse/tests/integration/test_remote_prewhere/test.py Cluster start called. is_up=False Cluster start called. is_up=False Docker networks for project roottestremoteprewhere-gw0 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestremoteprewhere-gw0 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestremoteprewhere-gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestremoteprewhere-gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestremoteprewhere-gw0 are DRIVER VOLUME NAME Docker volumes for project roottestremoteprewhere-gw0 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker networks for project roottestremoteprewhere-gw0 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestremoteprewhere-gw0 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestremoteprewhere-gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestremoteprewhere-gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestremoteprewhere-gw0 are DRIVER VOLUME NAME Docker volumes for project roottestremoteprewhere-gw0 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestremoteprewhere-gw0-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestremoteprewhere-gw0-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestremoteprewhere-gw0 No running containers for project: roottestremoteprewhere-gw0 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Executing query create workload B3 in Z settings priority = 1; on node Executing query create workload B3 in Z settings priority = 1; on node Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Executing query EXISTS replicated2.mysql_schema_inference_function on replica3 Executing query EXISTS replicated2.mysql_schema_inference_function on replica3 Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_3' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_3' on instance Stdout:12 Stdout:12 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 12 Volumes pruned: 12 Setup directory for instance: node1 Setup directory for instance: node1 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files [] to /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/node1/configs/config.d Copy custom test config files [] to /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/node1/configs/config.d Setup database dir /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/node1/database Setup database dir /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/node1/database Setup logs dir /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/node1/logs Setup logs dir /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/node1/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Setup directory for instance: node2 Setup directory for instance: node2 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files [] to /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/node2/configs/config.d Copy custom test config files [] to /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/node2/configs/config.d Setup database dir /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/node2/database Setup database dir /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/node2/database Setup logs dir /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/node2/logs Setup logs dir /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/node2/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw'} stored in /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw'} stored in /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/.env --project-name roottestremoteprewhere-gw0 --file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/node2/docker-compose.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/.env --project-name roottestremoteprewhere-gw0 --file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/node2/docker-compose.yml pull] Executing query create workload C1 in X settings priority = -1; on node Executing query create workload C1 in X settings priority = -1; on node Executing query RESTORE DATABASE replicated2 FROM Disk('backups', '2/') SETTINGS allow_different_database_def=1, allow_different_table_def=1 SETTINGS restore_replace_external_engines_to_null=1, restore_replace_external_table_functions_to_null=1, restore_replace_external_dictionary_source_to_null=1 on replica3 Executing query RESTORE DATABASE replicated2 FROM Disk('backups', '2/') SETTINGS allow_different_database_def=1, allow_different_table_def=1 SETTINGS restore_replace_external_engines_to_null=1, restore_replace_external_table_functions_to_null=1, restore_replace_external_dictionary_source_to_null=1 on replica3 Executing query select * from `postgres_database`.`postgresql_replica_3` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_3` order by key; on instance Executing query create workload C2 in X settings priority = -1; on node Executing query create workload C2 in X settings priority = -1; on node Executing query select * from `test_database`.`postgresql_replica_3` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_3` order by key; on instance Executing query create workload C3 in X settings priority = -1; on node Executing query create workload C3 in X settings priority = -1; on node Executing query SYSTEM SYNC DATABASE REPLICA replicated2 on replica1 Executing query SYSTEM SYNC DATABASE REPLICA replicated2 on replica1 http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Executing query SELECT * FROM `test_database`.`postgresql_replica_4` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_4` LIMIT 1 FORMAT Null on instance http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw6-proxy2-1/json HTTP/1.1" 200 None Executing query create workload D1 in X settings priority = 1; on node Executing query create workload D1 in X settings priority = 1; on node Executing query SELECT engine FROM system.tables where database = 'replicated2' and name = 'example_s3_engine_table' on replica1 Executing query SELECT engine FROM system.tables where database = 'replicated2' and name = 'example_s3_engine_table' on replica1 Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_4' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_4' on instance Stderr: Container roottests3imdssessiontoken-gw4-node-1 Stopping Stderr: Container roottests3imdssessiontoken-gw4-node-1 Stopping Stderr: Container roottests3imdssessiontoken-gw4-resolver-1 Stopping Stderr: Container roottests3imdssessiontoken-gw4-resolver-1 Stopping Stderr: Container roottests3imdssessiontoken-gw4-node-1 Stopped Stderr: Container roottests3imdssessiontoken-gw4-node-1 Stopped Stderr: Container roottests3imdssessiontoken-gw4-minio1-1 Stopping Stderr: Container roottests3imdssessiontoken-gw4-minio1-1 Stopping Stderr: Container roottests3imdssessiontoken-gw4-minio1-1 Stopped Stderr: Container roottests3imdssessiontoken-gw4-minio1-1 Stopped Stderr: Container roottests3imdssessiontoken-gw4-resolver-1 Stopped Stderr: Container roottests3imdssessiontoken-gw4-resolver-1 Stopped Stderr: Container roottests3imdssessiontoken-gw4-proxy1-1 Stopping Stderr: Container roottests3imdssessiontoken-gw4-proxy1-1 Stopping Stderr: Container roottests3imdssessiontoken-gw4-proxy2-1 Stopping Stderr: Container roottests3imdssessiontoken-gw4-proxy2-1 Stopping Stderr: Container roottests3imdssessiontoken-gw4-proxy2-1 Stopped Stderr: Container roottests3imdssessiontoken-gw4-proxy2-1 Stopped Stderr: Container roottests3imdssessiontoken-gw4-proxy1-1 Stopped Stderr: Container roottests3imdssessiontoken-gw4-proxy1-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/.env --project-name roottests3imdssessiontoken-gw4 --file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/.env --project-name roottests3imdssessiontoken-gw4 --file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml down --volumes] http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/71fb5aee2b8d1c5170aa4cf5c2f4ba0498fd8b5aa6ea2aa1be9ea6e160a9d377/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/71fb5aee2b8d1c5170aa4cf5c2f4ba0498fd8b5aa6ea2aa1be9ea6e160a9d377/start HTTP/1.1" 101 0 Executing query SELECT count(), sum(id) FROM replicated2.mysql_schema_inference_engine on replica1 Executing query SELECT count(), sum(id) FROM replicated2.mysql_schema_inference_engine on replica1 Executing query select * from `postgres_database`.`postgresql_replica_4` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_4` order by key; on instance http://localhost:None "GET /v1.46/exec/71fb5aee2b8d1c5170aa4cf5c2f4ba0498fd8b5aa6ea2aa1be9ea6e160a9d377/json HTTP/1.1" 200 456 http://localhost:None "GET /v1.46/exec/71fb5aee2b8d1c5170aa4cf5c2f4ba0498fd8b5aa6ea2aa1be9ea6e160a9d377/json HTTP/1.1" 200 456 [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-d', '172.16.8.9', '--sport', '2181', '-j', 'DROP'] (0): [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-d', '172.16.8.9', '--sport', '2181', '-j', 'DROP'] (0): http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/1b48a2f697836cf5475d0b8671ccb1d31f9b692ddfc85df35f17a0dc2aa58e24/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/1b48a2f697836cf5475d0b8671ccb1d31f9b692ddfc85df35f17a0dc2aa58e24/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/exec/1b48a2f697836cf5475d0b8671ccb1d31f9b692ddfc85df35f17a0dc2aa58e24/json HTTP/1.1" 200 456 http://localhost:None "GET /v1.46/exec/1b48a2f697836cf5475d0b8671ccb1d31f9b692ddfc85df35f17a0dc2aa58e24/json HTTP/1.1" 200 456 [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-s', '172.16.8.9', '--dport', '2181', '-j', 'DROP'] (0): [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-s', '172.16.8.9', '--dport', '2181', '-j', 'DROP'] (0): Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node Executing query SELECT count(), sum(id) FROM replicated2.mysql_schema_inference_function on replica1 Executing query SELECT count(), sum(id) FROM replicated2.mysql_schema_inference_function on replica1 Executing query select * from `test_database`.`postgresql_replica_4` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_4` order by key; on instance Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/.env --project-name roottests3storageconfproxy-gw6 --file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/.env --project-name roottests3storageconfproxy-gw6 --file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml stop --timeout 20] [gw6] PASSED test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver] Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance [gw1] PASSED test_postgresql_replica_database_engine_1/test.py::test_replicating_dml Executing query SELECT count(), sum(id) FROM replicated2.merge_tree on replica1 Executing query SELECT count(), sum(id) FROM replicated2.merge_tree on replica1 Stderr: Container roottests3imdssessiontoken-gw4-resolver-1 Stopping Stderr: Container roottests3imdssessiontoken-gw4-resolver-1 Stopping Stderr: Container roottests3imdssessiontoken-gw4-node-1 Stopping Stderr: Container roottests3imdssessiontoken-gw4-node-1 Stopping Stderr: Container roottests3imdssessiontoken-gw4-resolver-1 Stopped Stderr: Container roottests3imdssessiontoken-gw4-resolver-1 Stopped Stderr: Container roottests3imdssessiontoken-gw4-resolver-1 Removing Stderr: Container roottests3imdssessiontoken-gw4-resolver-1 Removing Stderr: Container roottests3imdssessiontoken-gw4-node-1 Stopped Stderr: Container roottests3imdssessiontoken-gw4-node-1 Stopped Stderr: Container roottests3imdssessiontoken-gw4-node-1 Removing Stderr: Container roottests3imdssessiontoken-gw4-node-1 Removing Stderr: Container roottests3imdssessiontoken-gw4-node-1 Removed Stderr: Container roottests3imdssessiontoken-gw4-node-1 Removed Stderr: Container roottests3imdssessiontoken-gw4-minio1-1 Stopping Stderr: Container roottests3imdssessiontoken-gw4-minio1-1 Stopping Stderr: Container roottests3imdssessiontoken-gw4-resolver-1 Removed Stderr: Container roottests3imdssessiontoken-gw4-resolver-1 Removed Stderr: Container roottests3imdssessiontoken-gw4-minio1-1 Stopped Stderr: Container roottests3imdssessiontoken-gw4-minio1-1 Stopped Stderr: Container roottests3imdssessiontoken-gw4-minio1-1 Removing Stderr: Container roottests3imdssessiontoken-gw4-minio1-1 Removing Stderr: Container roottests3imdssessiontoken-gw4-minio1-1 Removed Stderr: Container roottests3imdssessiontoken-gw4-minio1-1 Removed Stderr: Container roottests3imdssessiontoken-gw4-proxy1-1 Stopping Stderr: Container roottests3imdssessiontoken-gw4-proxy1-1 Stopping Stderr: Container roottests3imdssessiontoken-gw4-proxy2-1 Stopping Stderr: Container roottests3imdssessiontoken-gw4-proxy2-1 Stopping Stderr: Container roottests3imdssessiontoken-gw4-proxy1-1 Stopped Stderr: Container roottests3imdssessiontoken-gw4-proxy1-1 Stopped Stderr: Container roottests3imdssessiontoken-gw4-proxy1-1 Removing Stderr: Container roottests3imdssessiontoken-gw4-proxy1-1 Removing Stderr: Container roottests3imdssessiontoken-gw4-proxy2-1 Stopped Stderr: Container roottests3imdssessiontoken-gw4-proxy2-1 Stopped Stderr: Container roottests3imdssessiontoken-gw4-proxy2-1 Removing Stderr: Container roottests3imdssessiontoken-gw4-proxy2-1 Removing Stderr: Container roottests3imdssessiontoken-gw4-proxy1-1 Removed Stderr: Container roottests3imdssessiontoken-gw4-proxy1-1 Removed Stderr: Container roottests3imdssessiontoken-gw4-proxy2-1 Removed Stderr: Container roottests3imdssessiontoken-gw4-proxy2-1 Removed Stderr: Volume roottests3imdssessiontoken-gw4_data1-1 Removing Stderr: Volume roottests3imdssessiontoken-gw4_data1-1 Removing Stderr: Network roottests3imdssessiontoken-gw4_default Removing Stderr: Network roottests3imdssessiontoken-gw4_default Removing Stderr: Volume roottests3imdssessiontoken-gw4_data1-1 Removed Stderr: Volume roottests3imdssessiontoken-gw4_data1-1 Removed Stderr: Network roottests3imdssessiontoken-gw4_default Removed Stderr: Network roottests3imdssessiontoken-gw4_default Removed Cleanup called Cleanup called Docker networks for project roottests3imdssessiontoken-gw4 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3imdssessiontoken-gw4 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3imdssessiontoken-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3imdssessiontoken-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3imdssessiontoken-gw4 are DRIVER VOLUME NAME Docker volumes for project roottests3imdssessiontoken-gw4 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottests3imdssessiontoken-gw4-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottests3imdssessiontoken-gw4-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottests3imdssessiontoken-gw4 No running containers for project: roottests3imdssessiontoken-gw4 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:10 Stdout:10 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 10 Volumes pruned: 10 test_s3_latency_log/test.py::test_latency_log ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 ENV HOSTNAME e7837a770c02 ENV HOSTNAME e7837a770c02 ENV SHLVL 0 ENV SHLVL 0 ENV HOME /root ENV HOME /root ENV OLDPWD / ENV OLDPWD / ENV DOCKER_HELPER_TAG 5dc43a6382f0 ENV DOCKER_HELPER_TAG 5dc43a6382f0 ENV PYTHONUNBUFFERED 1 ENV PYTHONUNBUFFERED 1 ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e ENV UBSAN_OPTIONS print_stacktrace=1 ENV UBSAN_OPTIONS print_stacktrace=1 ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_postgresql_replica_database_engine_1/test.py::test_different_data_types test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries test_postgresql_replica_database_engine_1/test.py::test_multiple_databases test_postgresql_replica_database_engine_1/test.py::test_quoting_1 test_postgresql_replica_database_engine_1/test.py::test_quoting_2 test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index test_postgresql_replica_database_engine_1/test.py::test_replicating_dml test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_single_transaction test_postgresql_replica_database_engine_1/test.py::test_table_schema_changes test_postgresql_replica_database_engine_1/test.py::test_user_managed_slots test_postgresql_replica_database_engine_1/test.py::test_virtual_columns test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers test_reload_client_certificate/test.py::test_correct_cn_cert test_reload_client_certificate/test.py::test_wrong_cn_cert test_reload_clusters_config/test.py::test_add_cluster test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_simple_reload test_reload_clusters_config/test.py::test_update_one_cluster test_remote_prewhere/test.py::test_remote test_remove_stale_moving_parts/test.py::test_remove_stale_moving_parts_without_zookeeper test_rename_column/test.py::test_rename_distributed test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select test_rename_column/test.py::test_rename_parallel test_rename_column/test.py::test_rename_parallel_same_node test_rename_column/test.py::test_rename_with_parallel_insert test_rename_column/test.py::test_rename_with_parallel_merges test_rename_column/test.py::test_rename_with_parallel_select test_rename_column/test.py::test_rename_with_parallel_slow_insert test_rename_column/test.py::test_rename_with_parallel_ttl_delete test_rename_column/test.py::test_rename_with_parallel_ttl_move test_replicated_merge_tree_compatibility/test.py::test_replicated_merge_tree_defaults_compatibility test_replicated_merge_tree_encrypted_disk/test.py::test_different_keys test_replicated_merge_tree_encrypted_disk/test.py::test_same_keys test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl test_replicated_merge_tree_s3_zero_copy/test.py::test_drop_table 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[0-16]' 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[8192-12]' test_replicated_merge_tree_s3_zero_copy/test.py::test_s3_check_restore test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns test_replicated_user_defined_functions/test.py::test_create_and_drop 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[false-expected_raise1]' 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[true-expected_raise0]' test_replicated_user_defined_functions/test.py::test_create_and_replace test_replicated_user_defined_functions/test.py::test_drop_if_exists test_replicated_user_defined_functions/test.py::test_reload_zookeeper test_replicated_user_defined_functions/test.py::test_replication test_replicated_user_defined_functions/test.py::test_replication_replace_by_another_node_after_creation test_replicated_user_defined_functions/test.py::test_server_restart test_replicated_user_defined_functions/test.py::test_start_without_zookeeper test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart test_restore_external_engines/test.py::test_restore_table test_restore_external_engines/test.py::test_restore_table_null test_rocksdb_options/test.py::test_invalid_block_based_table_options test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options test_s3_imds/test_session_token.py::test_credentials_from_metadata test_s3_imds/test_simple.py::test_credentials_from_metadata test_s3_latency_log/test.py::test_latency_log test_s3_low_cardinality_right_border/test.py::test_s3_right_border test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 test_s3_storage_class/test.py::test_s3_storage_class_right 'test_s3_storage_conf_new_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver]' test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy_no_proxy test_scheduler/test.py::test_create_workload test_scheduler/test.py::test_merge_workload test_scheduler/test.py::test_merge_workload_change test_scheduler/test.py::test_merge_workload_override test_scheduler/test.py::test_mutate_workload test_scheduler/test.py::test_mutation_workload_change test_scheduler/test.py::test_mutation_workload_override test_scheduler/test.py::test_resource_any_disk test_scheduler/test.py::test_resource_read_and_write test_scheduler/test.py::test_s3_disk test_scheduler/test.py::test_s3_resource_request_granularity test_scheduler/test.py::test_throw_on_unknown_workload test_scheduler/test.py::test_workload_entity_keeper_storage test_scheduler/test.py::test_workload_hierarchy_changes test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_settings_constraints_distributed/test.py::test_select_clamps_settings -vvv -ss ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_postgresql_replica_database_engine_1/test.py::test_different_data_types test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries test_postgresql_replica_database_engine_1/test.py::test_multiple_databases test_postgresql_replica_database_engine_1/test.py::test_quoting_1 test_postgresql_replica_database_engine_1/test.py::test_quoting_2 test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index test_postgresql_replica_database_engine_1/test.py::test_replicating_dml test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_single_transaction test_postgresql_replica_database_engine_1/test.py::test_table_schema_changes test_postgresql_replica_database_engine_1/test.py::test_user_managed_slots test_postgresql_replica_database_engine_1/test.py::test_virtual_columns test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers test_reload_client_certificate/test.py::test_correct_cn_cert test_reload_client_certificate/test.py::test_wrong_cn_cert test_reload_clusters_config/test.py::test_add_cluster test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_simple_reload test_reload_clusters_config/test.py::test_update_one_cluster test_remote_prewhere/test.py::test_remote test_remove_stale_moving_parts/test.py::test_remove_stale_moving_parts_without_zookeeper test_rename_column/test.py::test_rename_distributed test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select test_rename_column/test.py::test_rename_parallel test_rename_column/test.py::test_rename_parallel_same_node test_rename_column/test.py::test_rename_with_parallel_insert test_rename_column/test.py::test_rename_with_parallel_merges test_rename_column/test.py::test_rename_with_parallel_select test_rename_column/test.py::test_rename_with_parallel_slow_insert test_rename_column/test.py::test_rename_with_parallel_ttl_delete test_rename_column/test.py::test_rename_with_parallel_ttl_move test_replicated_merge_tree_compatibility/test.py::test_replicated_merge_tree_defaults_compatibility test_replicated_merge_tree_encrypted_disk/test.py::test_different_keys test_replicated_merge_tree_encrypted_disk/test.py::test_same_keys test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl test_replicated_merge_tree_s3_zero_copy/test.py::test_drop_table 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[0-16]' 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[8192-12]' test_replicated_merge_tree_s3_zero_copy/test.py::test_s3_check_restore test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns test_replicated_user_defined_functions/test.py::test_create_and_drop 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[false-expected_raise1]' 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[true-expected_raise0]' test_replicated_user_defined_functions/test.py::test_create_and_replace test_replicated_user_defined_functions/test.py::test_drop_if_exists test_replicated_user_defined_functions/test.py::test_reload_zookeeper test_replicated_user_defined_functions/test.py::test_replication test_replicated_user_defined_functions/test.py::test_replication_replace_by_another_node_after_creation test_replicated_user_defined_functions/test.py::test_server_restart test_replicated_user_defined_functions/test.py::test_start_without_zookeeper test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart test_restore_external_engines/test.py::test_restore_table test_restore_external_engines/test.py::test_restore_table_null test_rocksdb_options/test.py::test_invalid_block_based_table_options test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options test_s3_imds/test_session_token.py::test_credentials_from_metadata test_s3_imds/test_simple.py::test_credentials_from_metadata test_s3_latency_log/test.py::test_latency_log test_s3_low_cardinality_right_border/test.py::test_s3_right_border test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 test_s3_storage_class/test.py::test_s3_storage_class_right 'test_s3_storage_conf_new_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver]' test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy_no_proxy test_scheduler/test.py::test_create_workload test_scheduler/test.py::test_merge_workload test_scheduler/test.py::test_merge_workload_change test_scheduler/test.py::test_merge_workload_override test_scheduler/test.py::test_mutate_workload test_scheduler/test.py::test_mutation_workload_change test_scheduler/test.py::test_mutation_workload_override test_scheduler/test.py::test_resource_any_disk test_scheduler/test.py::test_resource_read_and_write test_scheduler/test.py::test_s3_disk test_scheduler/test.py::test_s3_resource_request_granularity test_scheduler/test.py::test_throw_on_unknown_workload test_scheduler/test.py::test_workload_entity_keeper_storage test_scheduler/test.py::test_workload_hierarchy_changes test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_settings_constraints_distributed/test.py::test_select_clamps_settings -vvv -ss ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge ENV COMPOSE_HTTP_TIMEOUT 600 ENV COMPOSE_HTTP_TIMEOUT 600 ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 ENV CLICKHOUSE_USE_OLD_ANALYZER 1 ENV CLICKHOUSE_USE_OLD_ANALYZER 1 ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ENV DOCKER_KERBERIZED_HADOOP_TAG latest ENV DOCKER_KERBERIZED_HADOOP_TAG latest ENV DOCKER_CHANNEL stable ENV DOCKER_CHANNEL stable ENV DOCKER_CLIENT_TIMEOUT 300 ENV DOCKER_CLIENT_TIMEOUT 300 ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e ENV PWD /ClickHouse/tests/integration ENV PWD /ClickHouse/tests/integration ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config ENV TZ Etc/UTC ENV TZ Etc/UTC ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java ENV DOCKER_BASE_TAG 8b2301119731 ENV DOCKER_BASE_TAG 8b2301119731 ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 ENV LC_CTYPE C.UTF-8 ENV LC_CTYPE C.UTF-8 ENV INTEGRATION_TESTS_RUN_ID 0 ENV INTEGRATION_TESTS_RUN_ID 0 ENV WORKER_FREE_PORTS 30200 30201 30202 30203 30204 30205 30206 30207 30208 30209 30210 30211 30212 30213 30214 30215 30216 30217 30218 30219 30220 30221 30222 30223 30224 30225 30226 30227 30228 30229 30230 30231 30232 30233 30234 30235 30236 30237 30238 30239 30240 30241 30242 30243 30244 30245 30246 30247 30248 30249 ENV WORKER_FREE_PORTS 30200 30201 30202 30203 30204 30205 30206 30207 30208 30209 30210 30211 30212 30213 30214 30215 30216 30217 30218 30219 30220 30221 30222 30223 30224 30225 30226 30227 30228 30229 30230 30231 30232 30233 30234 30235 30236 30237 30238 30239 30240 30241 30242 30243 30244 30245 30246 30247 30248 30249 ENV PYTEST_XDIST_TESTRUNUID abec1c7124634c26ad4fb6ef8710757d ENV PYTEST_XDIST_TESTRUNUID abec1c7124634c26ad4fb6ef8710757d ENV PYTEST_XDIST_WORKER gw4 ENV PYTEST_XDIST_WORKER gw4 ENV PYTEST_XDIST_WORKER_COUNT 10 ENV PYTEST_XDIST_WORKER_COUNT 10 ENV SSL_CERT_FILE /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/minio/certs/public.crt ENV SSL_CERT_FILE /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw4/minio/certs/public.crt ENV PYTEST_CURRENT_TEST test_s3_latency_log/test.py::test_latency_log (setup) ENV PYTEST_CURRENT_TEST test_s3_latency_log/test.py::test_latency_log (setup) CLUSTER INIT base_config_dir:/clickhouse-config CLUSTER INIT base_config_dir:/clickhouse-config clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log Cluster name: project_name:roottests3latencylog-gw4. Added instance name:node tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/.env', '--project-name', 'roottests3latencylog-gw4', '--file', '/ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Cluster name: project_name:roottests3latencylog-gw4. Added instance name:node tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/.env', '--project-name', 'roottests3latencylog-gw4', '--file', '/ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Starting cluster... Starting cluster... Running tests in /ClickHouse/tests/integration/test_s3_latency_log/test.py Running tests in /ClickHouse/tests/integration/test_s3_latency_log/test.py Cluster start called. is_up=False Cluster start called. is_up=False Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node Docker networks for project roottests3latencylog-gw4 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3latencylog-gw4 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3latencylog-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3latencylog-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Docker volumes for project roottests3latencylog-gw4 are DRIVER VOLUME NAME Docker volumes for project roottests3latencylog-gw4 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker networks for project roottests3latencylog-gw4 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3latencylog-gw4 are NETWORK ID NAME DRIVER SCOPE Executing query SELECT engine FROM system.tables where database = 'replicated2' and name like '%mysql%' on replica1 Executing query SELECT engine FROM system.tables where database = 'replicated2' and name like '%mysql%' on replica1 Docker containers for project roottests3latencylog-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3latencylog-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3latencylog-gw4 are DRIVER VOLUME NAME Docker volumes for project roottests3latencylog-gw4 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottests3latencylog-gw4-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottests3latencylog-gw4-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottests3latencylog-gw4 No running containers for project: roottests3latencylog-gw4 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:10 Stdout:10 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 10 Volumes pruned: 10 Setup directory for instance: node Setup directory for instance: node Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_s3_latency_log/configs/storage_conf.xml'] to /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/node/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_s3_latency_log/configs/storage_conf.xml'] to /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/node/configs/config.d Setup database dir /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/node/database Setup database dir /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/node/database Setup logs dir /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/node/logs Setup logs dir /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/node/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/.env --project-name roottests3latencylog-gw4 --file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/.env --project-name roottests3latencylog-gw4 --file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml pull] Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 Executing query SELECT engine FROM system.tables where database = 'replicated2' and name like '%merge_tree%' on replica1 Executing query SELECT engine FROM system.tables where database = 'replicated2' and name like '%merge_tree%' on replica1 Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query SHOW CREATE replicated2.dict1 on replica1 Executing query SHOW CREATE replicated2.dict1 on replica1 Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished Executing query INSERT INTO `postgres_database`.postgresql_replica_0 SELECT number, number from numbers(100000) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_0 SELECT number, number from numbers(100000) on instance Executing query SHOW CREATE replicated2.dict1 on replica1 Executing query SHOW CREATE replicated2.dict1 on replica1 Stderr: distributed Skipped - Image is already being pulled by node2 Stderr: distributed Skipped - Image is already being pulled by node2 Stderr: node1 Skipped - Image is already being pulled by node2 Stderr: node1 Skipped - Image is already being pulled by node2 Stderr: node2 Pulling Stderr: node2 Pulling Stderr: node2 Pulled Stderr: node2 Pulled ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/.env --project-name roottestsettingsconstraintsdistributed-gw2 --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/distributed/docker-compose.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/.env --project-name roottestsettingsconstraintsdistributed-gw2 --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/distributed/docker-compose.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/.env --project-name roottestsettingsconstraintsdistributed-gw2 --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/distributed/docker-compose.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/.env --project-name roottestsettingsconstraintsdistributed-gw2 --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/distributed/docker-compose.yml up -d --no-recreate] Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 Executing query SHOW CREATE replicated2.dict3 on replica1 Executing query SHOW CREATE replicated2.dict3 on replica1 Stderr: node2 Skipped - Image is already being pulled by node1 Stderr: node2 Skipped - Image is already being pulled by node1 Stderr: node1 Pulling Stderr: node1 Pulling Stderr: node1 Pulled Stderr: node1 Pulled ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/.env --project-name roottestremoteprewhere-gw0 --file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/node2/docker-compose.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/.env --project-name roottestremoteprewhere-gw0 --file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/node2/docker-compose.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/.env --project-name roottestremoteprewhere-gw0 --file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/node2/docker-compose.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/.env --project-name roottestremoteprewhere-gw0 --file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/node2/docker-compose.yml up -d --no-recreate] Executing query DROP DATABASE IF EXISTS replicated2 SYNC on replica1 Executing query DROP DATABASE IF EXISTS replicated2 SYNC on replica1 Stderr: minio1 Pulling Stderr: minio1 Pulling Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: node Pulling Stderr: node Pulling Stderr: resolver Pulling Stderr: resolver Pulling Stderr: proxy1 Pulling Stderr: proxy1 Pulling Stderr: proxy1 Pulled Stderr: proxy1 Pulled Stderr: node Pulled Stderr: node Pulled Stderr: minio1 Pulled Stderr: minio1 Pulled Stderr: resolver Pulled Stderr: resolver Pulled Trying to create Minio instance by command docker compose --project-name roottests3latencylog-gw4 --env-file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Trying to create Minio instance by command docker compose --project-name roottests3latencylog-gw4 --env-file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Command:[docker compose --project-name roottests3latencylog-gw4 --env-file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Command:[docker compose --project-name roottests3latencylog-gw4 --env-file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Stderr: node1 Skipped - Image is already being pulled by node2 Stderr: node1 Skipped - Image is already being pulled by node2 Stderr: zoo1 Skipped - Image is already being pulled by zoo3 Stderr: zoo1 Skipped - Image is already being pulled by zoo3 Stderr: zoo2 Skipped - Image is already being pulled by zoo3 Stderr: zoo2 Skipped - Image is already being pulled by zoo3 Stderr: node2 Pulling Stderr: node2 Pulling Stderr: zoo3 Pulling Stderr: zoo3 Pulling Stderr: node2 Pulled Stderr: node2 Pulled Stderr: zoo3 Pulled Stderr: zoo3 Pulled Setup ZooKeeper Setup ZooKeeper Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/keeper1/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/keeper1/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/keeper1/coordination', '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/keeper2/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/keeper2/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/keeper2/coordination', '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/keeper3/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/keeper3/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/keeper3/coordination'] Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/keeper1/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/keeper1/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/keeper1/coordination', '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/keeper2/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/keeper2/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/keeper2/coordination', '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/keeper3/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/keeper3/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/keeper3/coordination'] Command:[docker compose --project-name roottestreplicatedmergetreecompatibility-gw5 --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Command:[docker compose --project-name roottestreplicatedmergetreecompatibility-gw5 --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node Executing query INSERT INTO `postgres_database`.postgresql_replica_1 SELECT number, number from numbers(100000) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_1 SELECT number, number from numbers(100000) on instance Executing query DROP DATABASE IF EXISTS replicated2 SYNC on replica2 Executing query DROP DATABASE IF EXISTS replicated2 SYNC on replica2 Stderr: Network roottestsettingsconstraintsdistributed-gw2_default Creating Stderr: Network roottestsettingsconstraintsdistributed-gw2_default Creating Stderr: Network roottestsettingsconstraintsdistributed-gw2_default Created Stderr: Network roottestsettingsconstraintsdistributed-gw2_default Created Stderr: Container roottestsettingsconstraintsdistributed-gw2-distributed-1 Creating Stderr: Container roottestsettingsconstraintsdistributed-gw2-distributed-1 Creating Stderr: Container roottestsettingsconstraintsdistributed-gw2-node1-1 Creating Stderr: Container roottestsettingsconstraintsdistributed-gw2-node1-1 Creating Stderr: Container roottestsettingsconstraintsdistributed-gw2-node2-1 Creating Stderr: Container roottestsettingsconstraintsdistributed-gw2-node2-1 Creating Stderr: Container roottestsettingsconstraintsdistributed-gw2-distributed-1 Created Stderr: Container roottestsettingsconstraintsdistributed-gw2-distributed-1 Created Stderr: Container roottestsettingsconstraintsdistributed-gw2-node1-1 Created Stderr: Container roottestsettingsconstraintsdistributed-gw2-node1-1 Created Stderr: Container roottestsettingsconstraintsdistributed-gw2-node2-1 Created Stderr: Container roottestsettingsconstraintsdistributed-gw2-node2-1 Created Stderr: Container roottestsettingsconstraintsdistributed-gw2-distributed-1 Starting Stderr: Container roottestsettingsconstraintsdistributed-gw2-distributed-1 Starting Stderr: Container roottestsettingsconstraintsdistributed-gw2-node1-1 Starting Stderr: Container roottestsettingsconstraintsdistributed-gw2-node1-1 Starting Stderr: Container roottestsettingsconstraintsdistributed-gw2-node2-1 Starting Stderr: Container roottestsettingsconstraintsdistributed-gw2-node2-1 Starting Stderr: Container roottestsettingsconstraintsdistributed-gw2-node2-1 Started Stderr: Container roottestsettingsconstraintsdistributed-gw2-node2-1 Started Stderr: Container roottestsettingsconstraintsdistributed-gw2-node1-1 Started Stderr: Container roottestsettingsconstraintsdistributed-gw2-node1-1 Started Stderr: Container roottestsettingsconstraintsdistributed-gw2-distributed-1 Started Stderr: Container roottestsettingsconstraintsdistributed-gw2-distributed-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node1 get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottestsettingsconstraintsdistributed-gw2-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestsettingsconstraintsdistributed-gw2-node1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node1 get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottestsettingsconstraintsdistributed-gw2-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestsettingsconstraintsdistributed-gw2-node1-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node1, ip: 172.16.2.3... Waiting for ClickHouse start in node1, ip: 172.16.2.3... http://localhost:None "GET /v1.46/containers/roottestsettingsconstraintsdistributed-gw2-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestsettingsconstraintsdistributed-gw2-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/13acae273f77aeb4de5831dae7927c3c139d0d583b5e9148b8cbd402375b0e0e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/13acae273f77aeb4de5831dae7927c3c139d0d583b5e9148b8cbd402375b0e0e/json HTTP/1.1" 200 None Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 http://localhost:None "GET /v1.46/containers/13acae273f77aeb4de5831dae7927c3c139d0d583b5e9148b8cbd402375b0e0e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/13acae273f77aeb4de5831dae7927c3c139d0d583b5e9148b8cbd402375b0e0e/json HTTP/1.1" 200 None Executing query DROP DATABASE IF EXISTS replicated2 SYNC on replica3 Executing query DROP DATABASE IF EXISTS replicated2 SYNC on replica3 http://localhost:None "GET /v1.46/containers/13acae273f77aeb4de5831dae7927c3c139d0d583b5e9148b8cbd402375b0e0e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/13acae273f77aeb4de5831dae7927c3c139d0d583b5e9148b8cbd402375b0e0e/json HTTP/1.1" 200 None Stderr: Network roottestremoteprewhere-gw0_default Creating Stderr: Network roottestremoteprewhere-gw0_default Creating Stderr: Network roottestremoteprewhere-gw0_default Created Stderr: Network roottestremoteprewhere-gw0_default Created Stderr: Container roottestremoteprewhere-gw0-node1-1 Creating Stderr: Container roottestremoteprewhere-gw0-node1-1 Creating Stderr: Container roottestremoteprewhere-gw0-node2-1 Creating Stderr: Container roottestremoteprewhere-gw0-node2-1 Creating Stderr: Container roottestremoteprewhere-gw0-node2-1 Created Stderr: Container roottestremoteprewhere-gw0-node2-1 Created Stderr: Container roottestremoteprewhere-gw0-node1-1 Created Stderr: Container roottestremoteprewhere-gw0-node1-1 Created Stderr: Container roottestremoteprewhere-gw0-node1-1 Starting Stderr: Container roottestremoteprewhere-gw0-node1-1 Starting Stderr: Container roottestremoteprewhere-gw0-node2-1 Starting Stderr: Container roottestremoteprewhere-gw0-node2-1 Starting Stderr: Container roottestremoteprewhere-gw0-node2-1 Started Stderr: Container roottestremoteprewhere-gw0-node2-1 Started Stderr: Container roottestremoteprewhere-gw0-node1-1 Started Stderr: Container roottestremoteprewhere-gw0-node1-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node1 get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottestremoteprewhere-gw0-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestremoteprewhere-gw0-node1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node1 get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottestremoteprewhere-gw0-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestremoteprewhere-gw0-node1-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node1, ip: 172.16.6.2... Waiting for ClickHouse start in node1, ip: 172.16.6.2... http://localhost:None "GET /v1.46/containers/roottestremoteprewhere-gw0-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestremoteprewhere-gw0-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/5c645366f8a169d5fbfb3c9cccca7cc00cd223039d96094cddca82e2d6e80f1c/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/5c645366f8a169d5fbfb3c9cccca7cc00cd223039d96094cddca82e2d6e80f1c/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/13acae273f77aeb4de5831dae7927c3c139d0d583b5e9148b8cbd402375b0e0e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/13acae273f77aeb4de5831dae7927c3c139d0d583b5e9148b8cbd402375b0e0e/json HTTP/1.1" 200 None Command:[docker compose --env-file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/.env --project-name roottestrestoreexternalengines-gw9 --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_mysql_8_0.yml --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica2/docker-compose.yml --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica3/docker-compose.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/.env --project-name roottestrestoreexternalengines-gw9 --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_mysql_8_0.yml --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica2/docker-compose.yml --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica3/docker-compose.yml stop --timeout 20] http://localhost:None "GET /v1.46/containers/5c645366f8a169d5fbfb3c9cccca7cc00cd223039d96094cddca82e2d6e80f1c/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/5c645366f8a169d5fbfb3c9cccca7cc00cd223039d96094cddca82e2d6e80f1c/json HTTP/1.1" 200 None [gw9] PASSED test_restore_external_engines/test.py::test_restore_table_null http://localhost:None "GET /v1.46/containers/13acae273f77aeb4de5831dae7927c3c139d0d583b5e9148b8cbd402375b0e0e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/13acae273f77aeb4de5831dae7927c3c139d0d583b5e9148b8cbd402375b0e0e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/5c645366f8a169d5fbfb3c9cccca7cc00cd223039d96094cddca82e2d6e80f1c/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/5c645366f8a169d5fbfb3c9cccca7cc00cd223039d96094cddca82e2d6e80f1c/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/13acae273f77aeb4de5831dae7927c3c139d0d583b5e9148b8cbd402375b0e0e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/13acae273f77aeb4de5831dae7927c3c139d0d583b5e9148b8cbd402375b0e0e/json HTTP/1.1" 200 None Executing query INSERT INTO `postgres_database`.postgresql_replica_2 SELECT number, number from numbers(100000) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_2 SELECT number, number from numbers(100000) on instance http://localhost:None "GET /v1.46/containers/5c645366f8a169d5fbfb3c9cccca7cc00cd223039d96094cddca82e2d6e80f1c/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/5c645366f8a169d5fbfb3c9cccca7cc00cd223039d96094cddca82e2d6e80f1c/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/13acae273f77aeb4de5831dae7927c3c139d0d583b5e9148b8cbd402375b0e0e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/13acae273f77aeb4de5831dae7927c3c139d0d583b5e9148b8cbd402375b0e0e/json HTTP/1.1" 200 None Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node http://localhost:None "GET /v1.46/containers/5c645366f8a169d5fbfb3c9cccca7cc00cd223039d96094cddca82e2d6e80f1c/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/5c645366f8a169d5fbfb3c9cccca7cc00cd223039d96094cddca82e2d6e80f1c/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/13acae273f77aeb4de5831dae7927c3c139d0d583b5e9148b8cbd402375b0e0e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/13acae273f77aeb4de5831dae7927c3c139d0d583b5e9148b8cbd402375b0e0e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/5c645366f8a169d5fbfb3c9cccca7cc00cd223039d96094cddca82e2d6e80f1c/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/5c645366f8a169d5fbfb3c9cccca7cc00cd223039d96094cddca82e2d6e80f1c/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/13acae273f77aeb4de5831dae7927c3c139d0d583b5e9148b8cbd402375b0e0e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/13acae273f77aeb4de5831dae7927c3c139d0d583b5e9148b8cbd402375b0e0e/json HTTP/1.1" 200 None Stderr:time="2025-04-02T02:55:08Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:55:08Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottestreplicatedmergetreecompatibility-gw5_default Creating Stderr: Network roottestreplicatedmergetreecompatibility-gw5_default Creating Stderr: Network roottestreplicatedmergetreecompatibility-gw5_default Created Stderr: Network roottestreplicatedmergetreecompatibility-gw5_default Created Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo2-1 Creating Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo2-1 Creating Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo3-1 Creating Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo3-1 Creating Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo1-1 Creating Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo1-1 Creating Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo2-1 Created Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo2-1 Created Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo1-1 Created Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo1-1 Created Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo3-1 Created Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo3-1 Created Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo3-1 Starting Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo3-1 Starting Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo1-1 Starting Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo1-1 Starting Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo2-1 Starting Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo2-1 Starting Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo3-1 Started Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo3-1 Started Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo1-1 Started Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo1-1 Started Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo2-1 Started Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo2-1 Started Stderr:time="2025-04-02T02:55:09Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:55:09Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:55:09Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:55:09Z" level=debug msg="otel error" error="" Wait ZooKeeper to start Wait ZooKeeper to start get_instance_ip instance_name=zoo1 get_instance_ip instance_name=zoo1 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreecompatibility-gw5-zoo1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/5c645366f8a169d5fbfb3c9cccca7cc00cd223039d96094cddca82e2d6e80f1c/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/5c645366f8a169d5fbfb3c9cccca7cc00cd223039d96094cddca82e2d6e80f1c/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreecompatibility-gw5-zoo1-1/json HTTP/1.1" 200 None get_kazoo_client: zoo1, ip:172.16.9.4, port:2181, use_ssl:False get_kazoo_client: zoo1, ip:172.16.9.4, port:2181, use_ssl:False http://localhost:None "GET /v1.46/containers/13acae273f77aeb4de5831dae7927c3c139d0d583b5e9148b8cbd402375b0e0e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/13acae273f77aeb4de5831dae7927c3c139d0d583b5e9148b8cbd402375b0e0e/json HTTP/1.1" 200 None Connecting to 172.16.9.4(172.16.9.4):2181, use_ssl: False Connecting to 172.16.9.4(172.16.9.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 Connecting to 172.16.9.4(172.16.9.4):2181, use_ssl: False Connecting to 172.16.9.4(172.16.9.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/5c645366f8a169d5fbfb3c9cccca7cc00cd223039d96094cddca82e2d6e80f1c/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/5c645366f8a169d5fbfb3c9cccca7cc00cd223039d96094cddca82e2d6e80f1c/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/13acae273f77aeb4de5831dae7927c3c139d0d583b5e9148b8cbd402375b0e0e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/13acae273f77aeb4de5831dae7927c3c139d0d583b5e9148b8cbd402375b0e0e/json HTTP/1.1" 200 None Connecting to 172.16.9.4(172.16.9.4):2181, use_ssl: False Connecting to 172.16.9.4(172.16.9.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/5c645366f8a169d5fbfb3c9cccca7cc00cd223039d96094cddca82e2d6e80f1c/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/5c645366f8a169d5fbfb3c9cccca7cc00cd223039d96094cddca82e2d6e80f1c/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/13acae273f77aeb4de5831dae7927c3c139d0d583b5e9148b8cbd402375b0e0e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/13acae273f77aeb4de5831dae7927c3c139d0d583b5e9148b8cbd402375b0e0e/json HTTP/1.1" 200 None Stderr:time="2025-04-02T02:55:08Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:55:08Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottests3latencylog-gw4_default Creating Stderr: Network roottests3latencylog-gw4_default Creating Stderr: Network roottests3latencylog-gw4_default Created Stderr: Network roottests3latencylog-gw4_default Created Stderr: Volume "roottests3latencylog-gw4_data1-1" Creating Stderr: Volume "roottests3latencylog-gw4_data1-1" Creating Stderr: Volume "roottests3latencylog-gw4_data1-1" Created Stderr: Volume "roottests3latencylog-gw4_data1-1" Created Stderr: Container roottests3latencylog-gw4-proxy2-1 Creating Stderr: Container roottests3latencylog-gw4-proxy2-1 Creating Stderr: Container roottests3latencylog-gw4-proxy1-1 Creating Stderr: Container roottests3latencylog-gw4-proxy1-1 Creating Stderr: Container roottests3latencylog-gw4-proxy2-1 Created Stderr: Container roottests3latencylog-gw4-proxy2-1 Created Stderr: Container roottests3latencylog-gw4-proxy1-1 Created Stderr: Container roottests3latencylog-gw4-proxy1-1 Created Stderr: Container roottests3latencylog-gw4-resolver-1 Creating Stderr: Container roottests3latencylog-gw4-resolver-1 Creating Stderr: Container roottests3latencylog-gw4-minio1-1 Creating Stderr: Container roottests3latencylog-gw4-minio1-1 Creating Stderr: Container roottests3latencylog-gw4-resolver-1 Created Stderr: Container roottests3latencylog-gw4-resolver-1 Created Stderr: Container roottests3latencylog-gw4-minio1-1 Created Stderr: Container roottests3latencylog-gw4-minio1-1 Created Stderr: Container roottests3latencylog-gw4-proxy2-1 Starting Stderr: Container roottests3latencylog-gw4-proxy2-1 Starting Stderr: Container roottests3latencylog-gw4-proxy1-1 Starting Stderr: Container roottests3latencylog-gw4-proxy1-1 Starting Stderr: Container roottests3latencylog-gw4-proxy2-1 Started Stderr: Container roottests3latencylog-gw4-proxy2-1 Started Stderr: Container roottests3latencylog-gw4-proxy1-1 Started Stderr: Container roottests3latencylog-gw4-proxy1-1 Started Stderr: Container roottests3latencylog-gw4-resolver-1 Starting Stderr: Container roottests3latencylog-gw4-resolver-1 Starting Stderr: Container roottests3latencylog-gw4-minio1-1 Starting Stderr: Container roottests3latencylog-gw4-minio1-1 Starting Stderr: Container roottests3latencylog-gw4-minio1-1 Started Stderr: Container roottests3latencylog-gw4-minio1-1 Started Stderr: Container roottests3latencylog-gw4-resolver-1 Started Stderr: Container roottests3latencylog-gw4-resolver-1 Started Stderr:time="2025-04-02T02:55:09Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:55:09Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:55:09Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:55:09Z" level=debug msg="otel error" error="" Trying to connect to Minio... Trying to connect to Minio... get_instance_ip instance_name=minio1 get_instance_ip instance_name=minio1 http://localhost:None "GET /v1.46/containers/roottests3latencylog-gw4-minio1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3latencylog-gw4-minio1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=proxy1 get_instance_ip instance_name=proxy1 http://localhost:None "GET /v1.46/containers/roottests3latencylog-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3latencylog-gw4-proxy1-1/json HTTP/1.1" 200 None Starting new HTTP connection (1): 172.16.7.4:9001 Starting new HTTP connection (1): 172.16.7.4:9001 Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (2): 172.16.7.4:9001 Starting new HTTP connection (2): 172.16.7.4:9001 Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (3): 172.16.7.4:9001 Starting new HTTP connection (3): 172.16.7.4:9001 Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (4): 172.16.7.4:9001 Starting new HTTP connection (4): 172.16.7.4:9001 Can't connect to Minio: HTTPConnectionPool(host='172.16.7.4', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Can't connect to Minio: HTTPConnectionPool(host='172.16.7.4', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Executing query select name, create_query from system.resources order by all on node Executing query select name, create_query from system.resources order by all on node http://localhost:None "GET /v1.46/containers/5c645366f8a169d5fbfb3c9cccca7cc00cd223039d96094cddca82e2d6e80f1c/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/5c645366f8a169d5fbfb3c9cccca7cc00cd223039d96094cddca82e2d6e80f1c/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/13acae273f77aeb4de5831dae7927c3c139d0d583b5e9148b8cbd402375b0e0e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/13acae273f77aeb4de5831dae7927c3c139d0d583b5e9148b8cbd402375b0e0e/json HTTP/1.1" 200 None Connecting to 172.16.9.4(172.16.9.4):2181, use_ssl: False Connecting to 172.16.9.4(172.16.9.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/5c645366f8a169d5fbfb3c9cccca7cc00cd223039d96094cddca82e2d6e80f1c/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/5c645366f8a169d5fbfb3c9cccca7cc00cd223039d96094cddca82e2d6e80f1c/json HTTP/1.1" 200 None Executing query INSERT INTO `postgres_database`.postgresql_replica_3 SELECT number, number from numbers(100000) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_3 SELECT number, number from numbers(100000) on instance http://localhost:None "GET /v1.46/containers/13acae273f77aeb4de5831dae7927c3c139d0d583b5e9148b8cbd402375b0e0e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/13acae273f77aeb4de5831dae7927c3c139d0d583b5e9148b8cbd402375b0e0e/json HTTP/1.1" 200 None Executing query select name, create_query from system.resources order by all on node2 Executing query select name, create_query from system.resources order by all on node2 http://localhost:None "GET /v1.46/containers/5c645366f8a169d5fbfb3c9cccca7cc00cd223039d96094cddca82e2d6e80f1c/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/5c645366f8a169d5fbfb3c9cccca7cc00cd223039d96094cddca82e2d6e80f1c/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/13acae273f77aeb4de5831dae7927c3c139d0d583b5e9148b8cbd402375b0e0e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/13acae273f77aeb4de5831dae7927c3c139d0d583b5e9148b8cbd402375b0e0e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/5c645366f8a169d5fbfb3c9cccca7cc00cd223039d96094cddca82e2d6e80f1c/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/5c645366f8a169d5fbfb3c9cccca7cc00cd223039d96094cddca82e2d6e80f1c/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/13acae273f77aeb4de5831dae7927c3c139d0d583b5e9148b8cbd402375b0e0e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/13acae273f77aeb4de5831dae7927c3c139d0d583b5e9148b8cbd402375b0e0e/json HTTP/1.1" 200 None ClickHouse node1 started ClickHouse node1 started get_instance_ip instance_name=node2 get_instance_ip instance_name=node2 http://localhost:None "GET /v1.46/containers/roottestsettingsconstraintsdistributed-gw2-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestsettingsconstraintsdistributed-gw2-node2-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node2 get_instance_ip instance_name=node2 http://localhost:None "GET /v1.46/containers/roottestsettingsconstraintsdistributed-gw2-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestsettingsconstraintsdistributed-gw2-node2-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node2, ip: 172.16.2.2... Waiting for ClickHouse start in node2, ip: 172.16.2.2... http://localhost:None "GET /v1.46/containers/roottestsettingsconstraintsdistributed-gw2-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestsettingsconstraintsdistributed-gw2-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/586c2c11eee62c957784cee29dfb64f86f2d9f7a85c8f5005ff93c4848a6ba4d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/586c2c11eee62c957784cee29dfb64f86f2d9f7a85c8f5005ff93c4848a6ba4d/json HTTP/1.1" 200 None ClickHouse node2 started ClickHouse node2 started get_instance_ip instance_name=distributed get_instance_ip instance_name=distributed http://localhost:None "GET /v1.46/containers/roottestsettingsconstraintsdistributed-gw2-distributed-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestsettingsconstraintsdistributed-gw2-distributed-1/json HTTP/1.1" 200 None get_instance_ip instance_name=distributed get_instance_ip instance_name=distributed http://localhost:None "GET /v1.46/containers/roottestsettingsconstraintsdistributed-gw2-distributed-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestsettingsconstraintsdistributed-gw2-distributed-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in distributed, ip: 172.16.2.4... Waiting for ClickHouse start in distributed, ip: 172.16.2.4... http://localhost:None "GET /v1.46/containers/roottestsettingsconstraintsdistributed-gw2-distributed-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestsettingsconstraintsdistributed-gw2-distributed-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f916aeaf843fa6b1bd9c7942d2bbf40d83e227504d3319f0b39a8ecdccb3ff94/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f916aeaf843fa6b1bd9c7942d2bbf40d83e227504d3319f0b39a8ecdccb3ff94/json HTTP/1.1" 200 None ClickHouse distributed started ClickHouse distributed started Executing query CREATE USER shard on node1 Executing query CREATE USER shard on node1 Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster' and host_name='node_1' on node Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster' and host_name='node_1' on node http://localhost:None "GET /v1.46/containers/5c645366f8a169d5fbfb3c9cccca7cc00cd223039d96094cddca82e2d6e80f1c/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/5c645366f8a169d5fbfb3c9cccca7cc00cd223039d96094cddca82e2d6e80f1c/json HTTP/1.1" 200 None Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node Connecting to 172.16.9.4(172.16.9.4):2181, use_ssl: False Connecting to 172.16.9.4(172.16.9.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/5c645366f8a169d5fbfb3c9cccca7cc00cd223039d96094cddca82e2d6e80f1c/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/5c645366f8a169d5fbfb3c9cccca7cc00cd223039d96094cddca82e2d6e80f1c/json HTTP/1.1" 200 None ClickHouse node1 started ClickHouse node1 started get_instance_ip instance_name=node2 get_instance_ip instance_name=node2 http://localhost:None "GET /v1.46/containers/roottestremoteprewhere-gw0-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestremoteprewhere-gw0-node2-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node2 get_instance_ip instance_name=node2 http://localhost:None "GET /v1.46/containers/roottestremoteprewhere-gw0-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestremoteprewhere-gw0-node2-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node2, ip: 172.16.6.3... Waiting for ClickHouse start in node2, ip: 172.16.6.3... http://localhost:None "GET /v1.46/containers/roottestremoteprewhere-gw0-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestremoteprewhere-gw0-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/812d520e3ae9c4470fb3cdba35c9374adec2327370eb849e492824229bc98133/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/812d520e3ae9c4470fb3cdba35c9374adec2327370eb849e492824229bc98133/json HTTP/1.1" 200 None ClickHouse node2 started ClickHouse node2 started Executing query CREATE TABLE test_table( APIKey UInt32, CustomAttributeId UInt64, ProfileIDHash UInt64, DeviceIDHash UInt64, Data String) ENGINE = SummingMergeTree() ORDER BY (APIKey, CustomAttributeId, ProfileIDHash, DeviceIDHash, intHash32(DeviceIDHash)) on node1 Executing query CREATE TABLE test_table( APIKey UInt32, CustomAttributeId UInt64, ProfileIDHash UInt64, DeviceIDHash UInt64, Data String) ENGINE = SummingMergeTree() ORDER BY (APIKey, CustomAttributeId, ProfileIDHash, DeviceIDHash, intHash32(DeviceIDHash)) on node1 Executing query GRANT ALL ON *.* TO shard on node1 Executing query GRANT ALL ON *.* TO shard on node1 Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster2' and host_name='node_1' on node Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster2' and host_name='node_1' on node Executing query INSERT INTO `postgres_database`.postgresql_replica_4 SELECT number, number from numbers(100000) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_4 SELECT number, number from numbers(100000) on instance Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node2 Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node2 Executing query CREATE USER shard on node2 Executing query CREATE USER shard on node2 Executing query CREATE TABLE test_table( APIKey UInt32, CustomAttributeId UInt64, ProfileIDHash UInt64, DeviceIDHash UInt64, Data String) ENGINE = SummingMergeTree() ORDER BY (APIKey, CustomAttributeId, ProfileIDHash, DeviceIDHash, intHash32(DeviceIDHash)) on node2 Executing query CREATE TABLE test_table( APIKey UInt32, CustomAttributeId UInt64, ProfileIDHash UInt64, DeviceIDHash UInt64, Data String) ENGINE = SummingMergeTree() ORDER BY (APIKey, CustomAttributeId, ProfileIDHash, DeviceIDHash, intHash32(DeviceIDHash)) on node2 run container_id:roottestreloadclustersconfig-gw7-node-1 detach:False nothrow:False cmd: ['bash', '-c', "echo '\n\n \n \n \n true\n \n node_1\n 9000\n \n \n node_2\n 9000\n \n \n \n \n \n true\n \n node_1\n 9000\n \n \n node_2\n 9000\n \n \n \n \n \n true\n \n node_1\n 9000\n \n \n \n \n\n' > /etc/clickhouse-server/config.d/remote_servers.xml"] run container_id:roottestreloadclustersconfig-gw7-node-1 detach:False nothrow:False cmd: ['bash', '-c', "echo '\n\n \n \n \n true\n \n node_1\n 9000\n \n \n node_2\n 9000\n \n \n \n \n \n true\n \n node_1\n 9000\n \n \n node_2\n 9000\n \n \n \n \n \n true\n \n node_1\n 9000\n \n \n \n \n\n' > /etc/clickhouse-server/config.d/remote_servers.xml"] Command:[docker exec roottestreloadclustersconfig-gw7-node-1 bash -c echo ' true node_1 9000 node_2 9000 true node_1 9000 node_2 9000 true node_1 9000 ' > /etc/clickhouse-server/config.d/remote_servers.xml] Command:[docker exec roottestreloadclustersconfig-gw7-node-1 bash -c echo ' true node_1 9000 node_2 9000 true node_1 9000 node_2 9000 true node_1 9000 ' > /etc/clickhouse-server/config.d/remote_servers.xml] Executing query SYSTEM RELOAD CONFIG on node Executing query SYSTEM RELOAD CONFIG on node http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/c43c6bc34bedf52f85b46702863833dad00ff76b7ba051da4c22f756a0125ebc/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/c43c6bc34bedf52f85b46702863833dad00ff76b7ba051da4c22f756a0125ebc/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/exec/c43c6bc34bedf52f85b46702863833dad00ff76b7ba051da4c22f756a0125ebc/json HTTP/1.1" 200 460 http://localhost:None "GET /v1.46/exec/c43c6bc34bedf52f85b46702863833dad00ff76b7ba051da4c22f756a0125ebc/json HTTP/1.1" 200 460 [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-s', '172.16.8.9', '--dport', '2181', '-j', 'DROP'] (0): [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-s', '172.16.8.9', '--dport', '2181', '-j', 'DROP'] (0): http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/190b430ffdaa59553e00c9acf348aa3f72cf8b924d92cbe9f6b34f0a8a68b3d8/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/190b430ffdaa59553e00c9acf348aa3f72cf8b924d92cbe9f6b34f0a8a68b3d8/start HTTP/1.1" 101 0 Executing query GRANT ALL ON *.* TO shard on node2 Executing query GRANT ALL ON *.* TO shard on node2 http://localhost:None "GET /v1.46/exec/190b430ffdaa59553e00c9acf348aa3f72cf8b924d92cbe9f6b34f0a8a68b3d8/json HTTP/1.1" 200 460 http://localhost:None "GET /v1.46/exec/190b430ffdaa59553e00c9acf348aa3f72cf8b924d92cbe9f6b34f0a8a68b3d8/json HTTP/1.1" 200 460 [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-d', '172.16.8.9', '--sport', '2181', '-j', 'DROP'] (0): [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-d', '172.16.8.9', '--sport', '2181', '-j', 'DROP'] (0): Executing query create workload D2 in X settings priority = 1; on node Executing query create workload D2 in X settings priority = 1; on node Executing query SELECT 1 FROM remote('node{1,2}', default.test_table) WHERE (APIKey = 137715) AND (CustomAttributeId IN (45, 66)) AND (ProfileIDHash != 0) LIMIT 1 on node1 Executing query SELECT 1 FROM remote('node{1,2}', default.test_table) WHERE (APIKey = 137715) AND (CustomAttributeId IN (45, 66)) AND (ProfileIDHash != 0) LIMIT 1 on node1 Connecting to 172.16.9.4(172.16.9.4):2181, use_ssl: False Connecting to 172.16.9.4(172.16.9.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Starting new HTTP connection (5): 172.16.7.4:9001 Starting new HTTP connection (5): 172.16.7.4:9001 http://172.16.7.4:9001 "GET / HTTP/1.1" 200 0 http://172.16.7.4:9001 "GET / HTTP/1.1" 200 0 Connected to Minio. Connected to Minio. http://172.16.7.4:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.7.4:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.7.4:9001 "PUT /root HTTP/1.1" 200 0 http://172.16.7.4:9001 "PUT /root HTTP/1.1" 200 0 S3 bucket 'root' created S3 bucket 'root' created http://172.16.7.4:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.7.4:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.7.4:9001 "PUT /root2 HTTP/1.1" 200 0 http://172.16.7.4:9001 "PUT /root2 HTTP/1.1" 200 0 S3 bucket 'root2' created S3 bucket 'root2' created ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/.env --project-name roottests3latencylog-gw4 --file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/.env --project-name roottests3latencylog-gw4 --file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/.env --project-name roottests3latencylog-gw4 --file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/.env --project-name roottests3latencylog-gw4 --file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate] Executing query CREATE ROLE admin on distributed Executing query CREATE ROLE admin on distributed Executing query create workload D3 in X settings priority = 1; on node Executing query create workload D3 in X settings priority = 1; on node Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query DROP DATABASE IF EXISTS `test_database` on instance Command:[docker compose --env-file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/.env --project-name roottestremoteprewhere-gw0 --file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/node2/docker-compose.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/.env --project-name roottestremoteprewhere-gw0 --file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/node2/docker-compose.yml stop --timeout 20] [gw0] PASSED test_remote_prewhere/test.py::test_remote Executing query GRANT ALL ON *.* TO admin on distributed Executing query GRANT ALL ON *.* TO admin on distributed Stderr: Container roottests3latencylog-gw4-proxy2-1 Running Stderr: Container roottests3latencylog-gw4-proxy2-1 Running Stderr: Container roottests3latencylog-gw4-proxy1-1 Running Stderr: Container roottests3latencylog-gw4-proxy1-1 Running Stderr: Container roottests3latencylog-gw4-minio1-1 Running Stderr: Container roottests3latencylog-gw4-minio1-1 Running Stderr: Container roottests3latencylog-gw4-node-1 Creating Stderr: Container roottests3latencylog-gw4-node-1 Creating Stderr: Container roottests3latencylog-gw4-resolver-1 Running Stderr: Container roottests3latencylog-gw4-resolver-1 Running Stderr: Container roottests3latencylog-gw4-node-1 Created Stderr: Container roottests3latencylog-gw4-node-1 Created Stderr: Container roottests3latencylog-gw4-node-1 Starting Stderr: Container roottests3latencylog-gw4-node-1 Starting Stderr: Container roottests3latencylog-gw4-node-1 Started Stderr: Container roottests3latencylog-gw4-node-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottests3latencylog-gw4-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3latencylog-gw4-node-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottests3latencylog-gw4-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3latencylog-gw4-node-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node, ip: 172.16.7.6... Waiting for ClickHouse start in node, ip: 172.16.7.6... http://localhost:None "GET /v1.46/containers/roottests3latencylog-gw4-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3latencylog-gw4-node-1/json HTTP/1.1" 200 None Executing query drop workload A1; on node Executing query drop workload A1; on node http://localhost:None "GET /v1.46/containers/59f48fdb85148603eab4bf4c4781b1047c68ffd83651e88c65d00e0eb8d86499/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/59f48fdb85148603eab4bf4c4781b1047c68ffd83651e88c65d00e0eb8d86499/json HTTP/1.1" 200 None Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance http://localhost:None "GET /v1.46/containers/59f48fdb85148603eab4bf4c4781b1047c68ffd83651e88c65d00e0eb8d86499/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/59f48fdb85148603eab4bf4c4781b1047c68ffd83651e88c65d00e0eb8d86499/json HTTP/1.1" 200 None Executing query CREATE TABLE shard_settings (name String, value String) ENGINE = Distributed(test_cluster, system, settings); on distributed Executing query CREATE TABLE shard_settings (name String, value String) ENGINE = Distributed(test_cluster, system, settings); on distributed http://localhost:None "GET /v1.46/containers/59f48fdb85148603eab4bf4c4781b1047c68ffd83651e88c65d00e0eb8d86499/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/59f48fdb85148603eab4bf4c4781b1047c68ffd83651e88c65d00e0eb8d86499/json HTTP/1.1" 200 None Executing query drop workload B1; on node Executing query drop workload B1; on node http://localhost:None "GET /v1.46/containers/59f48fdb85148603eab4bf4c4781b1047c68ffd83651e88c65d00e0eb8d86499/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/59f48fdb85148603eab4bf4c4781b1047c68ffd83651e88c65d00e0eb8d86499/json HTTP/1.1" 200 None run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] Command:[docker exec -u root roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps -C clickhouse] Command:[docker exec -u root roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps -C clickhouse] Executing query SHOW DATABASES on instance Executing query SHOW DATABASES on instance http://localhost:None "GET /v1.46/containers/59f48fdb85148603eab4bf4c4781b1047c68ffd83651e88c65d00e0eb8d86499/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/59f48fdb85148603eab4bf4c4781b1047c68ffd83651e88c65d00e0eb8d86499/json HTTP/1.1" 200 None Stdout: PID TTY TIME CMD Stdout: PID TTY TIME CMD Stdout: 8 ? 00:00:01 clickhouse Stdout: 8 ? 00:00:01 clickhouse run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] Command:[docker exec -u root roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c pkill clickhouse] Command:[docker exec -u root roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c pkill clickhouse] Executing query drop workload C1; on node Executing query drop workload C1; on node run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] http://localhost:None "GET /v1.46/containers/59f48fdb85148603eab4bf4c4781b1047c68ffd83651e88c65d00e0eb8d86499/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/59f48fdb85148603eab4bf4c4781b1047c68ffd83651e88c65d00e0eb8d86499/json HTTP/1.1" 200 None Stdout:8 Stdout:8 http://localhost:None "GET /v1.46/containers/59f48fdb85148603eab4bf4c4781b1047c68ffd83651e88c65d00e0eb8d86499/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/59f48fdb85148603eab4bf4c4781b1047c68ffd83651e88c65d00e0eb8d86499/json HTTP/1.1" 200 None Executing query drop workload D1; on node Executing query drop workload D1; on node http://localhost:None "GET /v1.46/containers/59f48fdb85148603eab4bf4c4781b1047c68ffd83651e88c65d00e0eb8d86499/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/59f48fdb85148603eab4bf4c4781b1047c68ffd83651e88c65d00e0eb8d86499/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/59f48fdb85148603eab4bf4c4781b1047c68ffd83651e88c65d00e0eb8d86499/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/59f48fdb85148603eab4bf4c4781b1047c68ffd83651e88c65d00e0eb8d86499/json HTTP/1.1" 200 None Executing query drop workload A2; on node Executing query drop workload A2; on node Connecting to 172.16.9.4(172.16.9.4):2181, use_ssl: False Connecting to 172.16.9.4(172.16.9.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/59f48fdb85148603eab4bf4c4781b1047c68ffd83651e88c65d00e0eb8d86499/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/59f48fdb85148603eab4bf4c4781b1047c68ffd83651e88c65d00e0eb8d86499/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/59f48fdb85148603eab4bf4c4781b1047c68ffd83651e88c65d00e0eb8d86499/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/59f48fdb85148603eab4bf4c4781b1047c68ffd83651e88c65d00e0eb8d86499/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/59f48fdb85148603eab4bf4c4781b1047c68ffd83651e88c65d00e0eb8d86499/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/59f48fdb85148603eab4bf4c4781b1047c68ffd83651e88c65d00e0eb8d86499/json HTTP/1.1" 200 None Executing query drop workload B2; on node Executing query drop workload B2; on node http://localhost:None "GET /v1.46/containers/59f48fdb85148603eab4bf4c4781b1047c68ffd83651e88c65d00e0eb8d86499/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/59f48fdb85148603eab4bf4c4781b1047c68ffd83651e88c65d00e0eb8d86499/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/59f48fdb85148603eab4bf4c4781b1047c68ffd83651e88c65d00e0eb8d86499/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/59f48fdb85148603eab4bf4c4781b1047c68ffd83651e88c65d00e0eb8d86499/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/59f48fdb85148603eab4bf4c4781b1047c68ffd83651e88c65d00e0eb8d86499/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/59f48fdb85148603eab4bf4c4781b1047c68ffd83651e88c65d00e0eb8d86499/json HTTP/1.1" 200 None ClickHouse node started ClickHouse node started Cluster started Cluster started Starting custom S3 endpoint Starting custom S3 endpoint Starting mock server endpoint.py Starting mock server endpoint.py run container_id:roottests3latencylog-gw4-resolver-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname endpoint.py) && echo IyEvdXNyL2Jpbi9lbnYgcHl0aG9uMwppbXBvcnQgdGltZQoKZnJvbSBib3R0bGUgaW1wb3J0IHJlcXVlc3QsIHJlc3BvbnNlLCByb3V0ZSwgcnVuCgp0b3RhbCA9IDAKCgpkZWYgdGhyb3R0bGVfYW5kX2NvdW50KCk6CiAgICBnbG9iYWwgdG90YWwKICAgIHRvdGFsICs9IDEKICAgIHRpbWUuc2xlZXAoMSkKCgojIEhhbmRsZSBmb3IgTXVsdGlwbGVPYmplY3RzRGVsZXRlLgpAcm91dGUoIi88X2J1Y2tldD4iLCBbIlBPU1QiXSkKZGVmIGRlbGV0ZShfYnVja2V0KToKICAgIHRocm90dGxlX2FuZF9jb3VudCgpCiAgICByZXNwb25zZS5zZXRfaGVhZGVyKAogICAgICAgICJMb2NhdGlvbiIsICJodHRwOi8vbWluaW8xOjkwMDEvIiArIF9idWNrZXQgKyAiPyIgKyByZXF1ZXN0LnF1ZXJ5X3N0cmluZwogICAgKQogICAgcmVzcG9uc2Uuc3RhdHVzID0gMzA3CiAgICByZXR1cm4gIlJlZGlyZWN0ZWQiCgoKQHJvdXRlKCIvPF9idWNrZXQ+LzxfcGF0aDpwYXRoPiIsIFsiR0VUIiwgIlBPU1QiLCAiUFVUIiwgIkRFTEVURSJdKQpkZWYgc2VydmVyKF9idWNrZXQsIF9wYXRoKToKICAgIHRocm90dGxlX2FuZF9jb3VudCgpCiAgICByZXNwb25zZS5zZXRfaGVhZGVyKAogICAgICAgICJMb2NhdGlvbiIsCiAgICAgICAgImh0dHA6Ly9taW5pbzE6OTAwMS8iICsgX2J1Y2tldCArICIvIiArIF9wYXRoICsgIj8iICsgcmVxdWVzdC5xdWVyeV9zdHJpbmcsCiAgICApCiAgICByZXNwb25zZS5zdGF0dXMgPSAzMDcKICAgIHJldHVybiAiUmVkaXJlY3RlZCIKCgpAcm91dGUoIi90b3RhbCIsIFsiR0VUIl0pCmRlZiBnZXRfdG90YWwoKToKICAgIGdsb2JhbCB0b3RhbAogICAgcmV0dXJuIHN0cih0b3RhbCkKCgpAcm91dGUoIi8iKQpkZWYgcGluZygpOgogICAgcmV0dXJuICJPSyIKCgpydW4oaG9zdD0iMC4wLjAuMCIsIHBvcnQ9ODA4MCkK | base64 --decode > endpoint.py'] run container_id:roottests3latencylog-gw4-resolver-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname endpoint.py) && echo IyEvdXNyL2Jpbi9lbnYgcHl0aG9uMwppbXBvcnQgdGltZQoKZnJvbSBib3R0bGUgaW1wb3J0IHJlcXVlc3QsIHJlc3BvbnNlLCByb3V0ZSwgcnVuCgp0b3RhbCA9IDAKCgpkZWYgdGhyb3R0bGVfYW5kX2NvdW50KCk6CiAgICBnbG9iYWwgdG90YWwKICAgIHRvdGFsICs9IDEKICAgIHRpbWUuc2xlZXAoMSkKCgojIEhhbmRsZSBmb3IgTXVsdGlwbGVPYmplY3RzRGVsZXRlLgpAcm91dGUoIi88X2J1Y2tldD4iLCBbIlBPU1QiXSkKZGVmIGRlbGV0ZShfYnVja2V0KToKICAgIHRocm90dGxlX2FuZF9jb3VudCgpCiAgICByZXNwb25zZS5zZXRfaGVhZGVyKAogICAgICAgICJMb2NhdGlvbiIsICJodHRwOi8vbWluaW8xOjkwMDEvIiArIF9idWNrZXQgKyAiPyIgKyByZXF1ZXN0LnF1ZXJ5X3N0cmluZwogICAgKQogICAgcmVzcG9uc2Uuc3RhdHVzID0gMzA3CiAgICByZXR1cm4gIlJlZGlyZWN0ZWQiCgoKQHJvdXRlKCIvPF9idWNrZXQ+LzxfcGF0aDpwYXRoPiIsIFsiR0VUIiwgIlBPU1QiLCAiUFVUIiwgIkRFTEVURSJdKQpkZWYgc2VydmVyKF9idWNrZXQsIF9wYXRoKToKICAgIHRocm90dGxlX2FuZF9jb3VudCgpCiAgICByZXNwb25zZS5zZXRfaGVhZGVyKAogICAgICAgICJMb2NhdGlvbiIsCiAgICAgICAgImh0dHA6Ly9taW5pbzE6OTAwMS8iICsgX2J1Y2tldCArICIvIiArIF9wYXRoICsgIj8iICsgcmVxdWVzdC5xdWVyeV9zdHJpbmcsCiAgICApCiAgICByZXNwb25zZS5zdGF0dXMgPSAzMDcKICAgIHJldHVybiAiUmVkaXJlY3RlZCIKCgpAcm91dGUoIi90b3RhbCIsIFsiR0VUIl0pCmRlZiBnZXRfdG90YWwoKToKICAgIGdsb2JhbCB0b3RhbAogICAgcmV0dXJuIHN0cih0b3RhbCkKCgpAcm91dGUoIi8iKQpkZWYgcGluZygpOgogICAgcmV0dXJuICJPSyIKCgpydW4oaG9zdD0iMC4wLjAuMCIsIHBvcnQ9ODA4MCkK | base64 --decode > endpoint.py'] Command:[docker exec roottests3latencylog-gw4-resolver-1 bash -c mkdir -p $(dirname endpoint.py) && echo IyEvdXNyL2Jpbi9lbnYgcHl0aG9uMwppbXBvcnQgdGltZQoKZnJvbSBib3R0bGUgaW1wb3J0IHJlcXVlc3QsIHJlc3BvbnNlLCByb3V0ZSwgcnVuCgp0b3RhbCA9IDAKCgpkZWYgdGhyb3R0bGVfYW5kX2NvdW50KCk6CiAgICBnbG9iYWwgdG90YWwKICAgIHRvdGFsICs9IDEKICAgIHRpbWUuc2xlZXAoMSkKCgojIEhhbmRsZSBmb3IgTXVsdGlwbGVPYmplY3RzRGVsZXRlLgpAcm91dGUoIi88X2J1Y2tldD4iLCBbIlBPU1QiXSkKZGVmIGRlbGV0ZShfYnVja2V0KToKICAgIHRocm90dGxlX2FuZF9jb3VudCgpCiAgICByZXNwb25zZS5zZXRfaGVhZGVyKAogICAgICAgICJMb2NhdGlvbiIsICJodHRwOi8vbWluaW8xOjkwMDEvIiArIF9idWNrZXQgKyAiPyIgKyByZXF1ZXN0LnF1ZXJ5X3N0cmluZwogICAgKQogICAgcmVzcG9uc2Uuc3RhdHVzID0gMzA3CiAgICByZXR1cm4gIlJlZGlyZWN0ZWQiCgoKQHJvdXRlKCIvPF9idWNrZXQ+LzxfcGF0aDpwYXRoPiIsIFsiR0VUIiwgIlBPU1QiLCAiUFVUIiwgIkRFTEVURSJdKQpkZWYgc2VydmVyKF9idWNrZXQsIF9wYXRoKToKICAgIHRocm90dGxlX2FuZF9jb3VudCgpCiAgICByZXNwb25zZS5zZXRfaGVhZGVyKAogICAgICAgICJMb2NhdGlvbiIsCiAgICAgICAgImh0dHA6Ly9taW5pbzE6OTAwMS8iICsgX2J1Y2tldCArICIvIiArIF9wYXRoICsgIj8iICsgcmVxdWVzdC5xdWVyeV9zdHJpbmcsCiAgICApCiAgICByZXNwb25zZS5zdGF0dXMgPSAzMDcKICAgIHJldHVybiAiUmVkaXJlY3RlZCIKCgpAcm91dGUoIi90b3RhbCIsIFsiR0VUIl0pCmRlZiBnZXRfdG90YWwoKToKICAgIGdsb2JhbCB0b3RhbAogICAgcmV0dXJuIHN0cih0b3RhbCkKCgpAcm91dGUoIi8iKQpkZWYgcGluZygpOgogICAgcmV0dXJuICJPSyIKCgpydW4oaG9zdD0iMC4wLjAuMCIsIHBvcnQ9ODA4MCkK | base64 --decode > endpoint.py] Command:[docker exec roottests3latencylog-gw4-resolver-1 bash -c mkdir -p $(dirname endpoint.py) && echo IyEvdXNyL2Jpbi9lbnYgcHl0aG9uMwppbXBvcnQgdGltZQoKZnJvbSBib3R0bGUgaW1wb3J0IHJlcXVlc3QsIHJlc3BvbnNlLCByb3V0ZSwgcnVuCgp0b3RhbCA9IDAKCgpkZWYgdGhyb3R0bGVfYW5kX2NvdW50KCk6CiAgICBnbG9iYWwgdG90YWwKICAgIHRvdGFsICs9IDEKICAgIHRpbWUuc2xlZXAoMSkKCgojIEhhbmRsZSBmb3IgTXVsdGlwbGVPYmplY3RzRGVsZXRlLgpAcm91dGUoIi88X2J1Y2tldD4iLCBbIlBPU1QiXSkKZGVmIGRlbGV0ZShfYnVja2V0KToKICAgIHRocm90dGxlX2FuZF9jb3VudCgpCiAgICByZXNwb25zZS5zZXRfaGVhZGVyKAogICAgICAgICJMb2NhdGlvbiIsICJodHRwOi8vbWluaW8xOjkwMDEvIiArIF9idWNrZXQgKyAiPyIgKyByZXF1ZXN0LnF1ZXJ5X3N0cmluZwogICAgKQogICAgcmVzcG9uc2Uuc3RhdHVzID0gMzA3CiAgICByZXR1cm4gIlJlZGlyZWN0ZWQiCgoKQHJvdXRlKCIvPF9idWNrZXQ+LzxfcGF0aDpwYXRoPiIsIFsiR0VUIiwgIlBPU1QiLCAiUFVUIiwgIkRFTEVURSJdKQpkZWYgc2VydmVyKF9idWNrZXQsIF9wYXRoKToKICAgIHRocm90dGxlX2FuZF9jb3VudCgpCiAgICByZXNwb25zZS5zZXRfaGVhZGVyKAogICAgICAgICJMb2NhdGlvbiIsCiAgICAgICAgImh0dHA6Ly9taW5pbzE6OTAwMS8iICsgX2J1Y2tldCArICIvIiArIF9wYXRoICsgIj8iICsgcmVxdWVzdC5xdWVyeV9zdHJpbmcsCiAgICApCiAgICByZXNwb25zZS5zdGF0dXMgPSAzMDcKICAgIHJldHVybiAiUmVkaXJlY3RlZCIKCgpAcm91dGUoIi90b3RhbCIsIFsiR0VUIl0pCmRlZiBnZXRfdG90YWwoKToKICAgIGdsb2JhbCB0b3RhbAogICAgcmV0dXJuIHN0cih0b3RhbCkKCgpAcm91dGUoIi8iKQpkZWYgcGluZygpOgogICAgcmV0dXJuICJPSyIKCgpydW4oaG9zdD0iMC4wLjAuMCIsIHBvcnQ9ODA4MCkK | base64 --decode > endpoint.py] Executing query drop workload C2; on node Executing query drop workload C2; on node run container_id:roottests3latencylog-gw4-resolver-1 detach:True nothrow:False cmd: ['bash', '-c', 'python3 endpoint.py 8080 >/var/log/resolver/endpoint.log 2>/var/log/resolver/endpoint.err.log'] run container_id:roottests3latencylog-gw4-resolver-1 detach:True nothrow:False cmd: ['bash', '-c', 'python3 endpoint.py 8080 >/var/log/resolver/endpoint.log 2>/var/log/resolver/endpoint.err.log'] Command:[docker exec roottests3latencylog-gw4-resolver-1 bash -c python3 endpoint.py 8080 >/var/log/resolver/endpoint.log 2>/var/log/resolver/endpoint.err.log] Command:[docker exec roottests3latencylog-gw4-resolver-1 bash -c python3 endpoint.py 8080 >/var/log/resolver/endpoint.log 2>/var/log/resolver/endpoint.err.log] run container_id:roottests3latencylog-gw4-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8080/'] run container_id:roottests3latencylog-gw4-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8080/'] Command:[docker exec roottests3latencylog-gw4-resolver-1 curl -s http://localhost:8080/] Command:[docker exec roottests3latencylog-gw4-resolver-1 curl -s http://localhost:8080/] run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:8 Stdout:8 Exitcode:7 Exitcode:7 run container_id:roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] run container_id:roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] Command:[docker exec -u root roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 bash -c ps -C clickhouse] Command:[docker exec -u root roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 bash -c ps -C clickhouse] Stdout: PID TTY TIME CMD Stdout: PID TTY TIME CMD Stdout: 8 ? 00:00:46 clickhouse Stdout: 8 ? 00:00:46 clickhouse run container_id:roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] run container_id:roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] Command:[docker exec -u root roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 bash -c pkill clickhouse] Command:[docker exec -u root roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 bash -c pkill clickhouse] Executing query drop workload D2; on node Executing query drop workload D2; on node run container_id:roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster' and host_name='node_1' on node Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster' and host_name='node_1' on node Stdout:8 Stdout:8 Executing query drop workload A3; on node Executing query drop workload A3; on node Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster2' and host_name='node_1' on node Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster2' and host_name='node_1' on node Executing query drop workload B3; on node Executing query drop workload B3; on node Executing query SELECT * FROM system.clusters WHERE cluster='test_cluster3' on node Executing query SELECT * FROM system.clusters WHERE cluster='test_cluster3' on node Executing query drop workload C3; on node Executing query drop workload C3; on node run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] run container_id:roottests3latencylog-gw4-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8080/'] run container_id:roottests3latencylog-gw4-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8080/'] Command:[docker exec roottests3latencylog-gw4-resolver-1 curl -s http://localhost:8080/] Command:[docker exec roottests3latencylog-gw4-resolver-1 curl -s http://localhost:8080/] Stdout:8 Stdout:8 Stdout:OK Stdout:OK endpoint.py answered OK on attempt 2 endpoint.py answered OK on attempt 2 Mock server endpoint.py started Mock server endpoint.py started S3 endpoint started S3 endpoint started Executing query CREATE TABLE s3_latency_log_test ( id Int64, data String ) ENGINE=MergeTree() ORDER BY id SETTINGS storage_policy='s3' on node Executing query CREATE TABLE s3_latency_log_test ( id Int64, data String ) ENGINE=MergeTree() ORDER BY id SETTINGS storage_policy='s3' on node Executing query drop workload D3; on node Executing query drop workload D3; on node run container_id:roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:8 Stdout:8 Stderr: Container roottestremoteprewhere-gw0-node2-1 Stopping Stderr: Container roottestremoteprewhere-gw0-node2-1 Stopping Stderr: Container roottestremoteprewhere-gw0-node1-1 Stopping Stderr: Container roottestremoteprewhere-gw0-node1-1 Stopping Stderr: Container roottestremoteprewhere-gw0-node1-1 Stopped Stderr: Container roottestremoteprewhere-gw0-node1-1 Stopped Stderr: Container roottestremoteprewhere-gw0-node2-1 Stopped Stderr: Container roottestremoteprewhere-gw0-node2-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/node2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/node2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/node2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/node2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/.env --project-name roottestremoteprewhere-gw0 --file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/node2/docker-compose.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/.env --project-name roottestremoteprewhere-gw0 --file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw0/node2/docker-compose.yml down --volumes] Executing query drop workload X; on node Executing query drop workload X; on node Executing query drop workload Y; on node Executing query drop workload Y; on node Stderr: Container roottestrestoreexternalengines-gw9-replica1-1 Stopping Stderr: Container roottestrestoreexternalengines-gw9-replica1-1 Stopping Stderr: Container roottestrestoreexternalengines-gw9-replica2-1 Stopping Stderr: Container roottestrestoreexternalengines-gw9-replica2-1 Stopping Stderr: Container roottestrestoreexternalengines-gw9-replica3-1 Stopping Stderr: Container roottestrestoreexternalengines-gw9-replica3-1 Stopping Stderr: Container roottestrestoreexternalengines-gw9-replica3-1 Stopped Stderr: Container roottestrestoreexternalengines-gw9-replica3-1 Stopped Stderr: Container roottestrestoreexternalengines-gw9-replica2-1 Stopped Stderr: Container roottestrestoreexternalengines-gw9-replica2-1 Stopped Stderr: Container roottestrestoreexternalengines-gw9-replica1-1 Stopped Stderr: Container roottestrestoreexternalengines-gw9-replica1-1 Stopped Stderr: Container roottestrestoreexternalengines-gw9-zoo1-1 Stopping Stderr: Container roottestrestoreexternalengines-gw9-zoo1-1 Stopping Stderr: Container roottestrestoreexternalengines-gw9-zoo3-1 Stopping Stderr: Container roottestrestoreexternalengines-gw9-zoo3-1 Stopping Stderr: Container roottestrestoreexternalengines-gw9-mysql80-1 Stopping Stderr: Container roottestrestoreexternalengines-gw9-mysql80-1 Stopping Stderr: Container roottestrestoreexternalengines-gw9-zoo2-1 Stopping Stderr: Container roottestrestoreexternalengines-gw9-zoo2-1 Stopping Stderr: Container roottestrestoreexternalengines-gw9-zoo3-1 Stopped Stderr: Container roottestrestoreexternalengines-gw9-zoo3-1 Stopped Stderr: Container roottestrestoreexternalengines-gw9-zoo2-1 Stopped Stderr: Container roottestrestoreexternalengines-gw9-zoo2-1 Stopped Stderr: Container roottestrestoreexternalengines-gw9-zoo1-1 Stopped Stderr: Container roottestrestoreexternalengines-gw9-zoo1-1 Stopped Stderr: Container roottestrestoreexternalengines-gw9-mysql80-1 Stopped Stderr: Container roottestrestoreexternalengines-gw9-mysql80-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica3/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica3/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica3/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica3/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/.env --project-name roottestrestoreexternalengines-gw9 --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_mysql_8_0.yml --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica2/docker-compose.yml --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica3/docker-compose.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/.env --project-name roottestrestoreexternalengines-gw9 --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_mysql_8_0.yml --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica2/docker-compose.yml --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw9/replica3/docker-compose.yml down --volumes] Executing query drop workload Z; on node Executing query drop workload Z; on node Connecting to 172.16.9.4(172.16.9.4):2181, use_ssl: False Connecting to 172.16.9.4(172.16.9.4):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Stderr: Container roottestremoteprewhere-gw0-node1-1 Stopping Stderr: Container roottestremoteprewhere-gw0-node1-1 Stopping Stderr: Container roottestremoteprewhere-gw0-node2-1 Stopping Stderr: Container roottestremoteprewhere-gw0-node2-1 Stopping Stderr: Container roottestremoteprewhere-gw0-node1-1 Stopped Stderr: Container roottestremoteprewhere-gw0-node1-1 Stopped Stderr: Container roottestremoteprewhere-gw0-node1-1 Removing Stderr: Container roottestremoteprewhere-gw0-node1-1 Removing Stderr: Container roottestremoteprewhere-gw0-node2-1 Stopped Stderr: Container roottestremoteprewhere-gw0-node2-1 Stopped Stderr: Container roottestremoteprewhere-gw0-node2-1 Removing Stderr: Container roottestremoteprewhere-gw0-node2-1 Removing Stderr: Container roottestremoteprewhere-gw0-node2-1 Removed Stderr: Container roottestremoteprewhere-gw0-node2-1 Removed Stderr: Container roottestremoteprewhere-gw0-node1-1 Removed Stderr: Container roottestremoteprewhere-gw0-node1-1 Removed Stderr: Network roottestremoteprewhere-gw0_default Removing Stderr: Network roottestremoteprewhere-gw0_default Removing Stderr: Network roottestremoteprewhere-gw0_default Removed Stderr: Network roottestremoteprewhere-gw0_default Removed Cleanup called Cleanup called Docker networks for project roottestremoteprewhere-gw0 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestremoteprewhere-gw0 are NETWORK ID NAME DRIVER SCOPE Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo2 get_instance_ip instance_name=zoo2 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreecompatibility-gw5-zoo2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreecompatibility-gw5-zoo2-1/json HTTP/1.1" 200 None get_kazoo_client: zoo2, ip:172.16.9.3, port:2181, use_ssl:False get_kazoo_client: zoo2, ip:172.16.9.3, port:2181, use_ssl:False Connecting to 172.16.9.3(172.16.9.3):2181, use_ssl: False Connecting to 172.16.9.3(172.16.9.3):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Docker containers for project roottestremoteprewhere-gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestremoteprewhere-gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Executing query drop workload all; on node Executing query drop workload all; on node Docker volumes for project roottestremoteprewhere-gw0 are DRIVER VOLUME NAME Docker volumes for project roottestremoteprewhere-gw0 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestremoteprewhere-gw0-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestremoteprewhere-gw0-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestremoteprewhere-gw0 No running containers for project: roottestremoteprewhere-gw0 Trying to prune unused networks... Trying to prune unused networks... run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:11 Stdout:11 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 11 Volumes pruned: 11 Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart get_instance_ip instance_name=zoo3 get_instance_ip instance_name=zoo3 ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 ENV HOSTNAME e7837a770c02 ENV HOSTNAME e7837a770c02 ENV SHLVL 0 ENV SHLVL 0 ENV HOME /root ENV HOME /root ENV OLDPWD / ENV OLDPWD / ENV DOCKER_HELPER_TAG 5dc43a6382f0 ENV DOCKER_HELPER_TAG 5dc43a6382f0 ENV PYTHONUNBUFFERED 1 ENV PYTHONUNBUFFERED 1 ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreecompatibility-gw5-zoo3-1/json HTTP/1.1" 200 None ENV UBSAN_OPTIONS print_stacktrace=1 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreecompatibility-gw5-zoo3-1/json HTTP/1.1" 200 None ENV UBSAN_OPTIONS print_stacktrace=1 ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_postgresql_replica_database_engine_1/test.py::test_different_data_types test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries test_postgresql_replica_database_engine_1/test.py::test_multiple_databases test_postgresql_replica_database_engine_1/test.py::test_quoting_1 test_postgresql_replica_database_engine_1/test.py::test_quoting_2 test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index test_postgresql_replica_database_engine_1/test.py::test_replicating_dml test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_single_transaction test_postgresql_replica_database_engine_1/test.py::test_table_schema_changes test_postgresql_replica_database_engine_1/test.py::test_user_managed_slots test_postgresql_replica_database_engine_1/test.py::test_virtual_columns test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers test_reload_client_certificate/test.py::test_correct_cn_cert test_reload_client_certificate/test.py::test_wrong_cn_cert test_reload_clusters_config/test.py::test_add_cluster test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_simple_reload test_reload_clusters_config/test.py::test_update_one_cluster test_remote_prewhere/test.py::test_remote test_remove_stale_moving_parts/test.py::test_remove_stale_moving_parts_without_zookeeper test_rename_column/test.py::test_rename_distributed test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select test_rename_column/test.py::test_rename_parallel test_rename_column/test.py::test_rename_parallel_same_node test_rename_column/test.py::test_rename_with_parallel_insert test_rename_column/test.py::test_rename_with_parallel_merges test_rename_column/test.py::test_rename_with_parallel_select test_rename_column/test.py::test_rename_with_parallel_slow_insert test_rename_column/test.py::test_rename_with_parallel_ttl_delete test_rename_column/test.py::test_rename_with_parallel_ttl_move test_replicated_merge_tree_compatibility/test.py::test_replicated_merge_tree_defaults_compatibility test_replicated_merge_tree_encrypted_disk/test.py::test_different_keys test_replicated_merge_tree_encrypted_disk/test.py::test_same_keys test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl test_replicated_merge_tree_s3_zero_copy/test.py::test_drop_table 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[0-16]' 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[8192-12]' test_replicated_merge_tree_s3_zero_copy/test.py::test_s3_check_restore test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns test_replicated_user_defined_functions/test.py::test_create_and_drop 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[false-expected_raise1]' 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[true-expected_raise0]' test_replicated_user_defined_functions/test.py::test_create_and_replace test_replicated_user_defined_functions/test.py::test_drop_if_exists test_replicated_user_defined_functions/test.py::test_reload_zookeeper test_replicated_user_defined_functions/test.py::test_replication test_replicated_user_defined_functions/test.py::test_replication_replace_by_another_node_after_creation test_replicated_user_defined_functions/test.py::test_server_restart test_replicated_user_defined_functions/test.py::test_start_without_zookeeper test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart test_restore_external_engines/test.py::test_restore_table test_restore_external_engines/test.py::test_restore_table_null test_rocksdb_options/test.py::test_invalid_block_based_table_options test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options test_s3_imds/test_session_token.py::test_credentials_from_metadata test_s3_imds/test_simple.py::test_credentials_from_metadata test_s3_latency_log/test.py::test_latency_log test_s3_low_cardinality_right_border/test.py::test_s3_right_border test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 test_s3_storage_class/test.py::test_s3_storage_class_right 'test_s3_storage_conf_new_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver]' test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy_no_proxy test_scheduler/test.py::test_create_workload test_scheduler/test.py::test_merge_workload test_scheduler/test.py::test_merge_workload_change test_scheduler/test.py::test_merge_workload_override test_scheduler/test.py::test_mutate_workload test_scheduler/test.py::test_mutation_workload_change test_scheduler/test.py::test_mutation_workload_override test_scheduler/test.py::test_resource_any_disk test_scheduler/test.py::test_resource_read_and_write test_scheduler/test.py::test_s3_disk test_scheduler/test.py::test_s3_resource_request_granularity test_scheduler/test.py::test_throw_on_unknown_workload test_scheduler/test.py::test_workload_entity_keeper_storage test_scheduler/test.py::test_workload_hierarchy_changes test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_settings_constraints_distributed/test.py::test_select_clamps_settings -vvv -ss ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_postgresql_replica_database_engine_1/test.py::test_different_data_types test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries test_postgresql_replica_database_engine_1/test.py::test_multiple_databases test_postgresql_replica_database_engine_1/test.py::test_quoting_1 test_postgresql_replica_database_engine_1/test.py::test_quoting_2 test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index test_postgresql_replica_database_engine_1/test.py::test_replicating_dml test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_single_transaction test_postgresql_replica_database_engine_1/test.py::test_table_schema_changes test_postgresql_replica_database_engine_1/test.py::test_user_managed_slots test_postgresql_replica_database_engine_1/test.py::test_virtual_columns test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers test_reload_client_certificate/test.py::test_correct_cn_cert test_reload_client_certificate/test.py::test_wrong_cn_cert test_reload_clusters_config/test.py::test_add_cluster test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_simple_reload test_reload_clusters_config/test.py::test_update_one_cluster test_remote_prewhere/test.py::test_remote test_remove_stale_moving_parts/test.py::test_remove_stale_moving_parts_without_zookeeper test_rename_column/test.py::test_rename_distributed test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select test_rename_column/test.py::test_rename_parallel test_rename_column/test.py::test_rename_parallel_same_node test_rename_column/test.py::test_rename_with_parallel_insert test_rename_column/test.py::test_rename_with_parallel_merges test_rename_column/test.py::test_rename_with_parallel_select test_rename_column/test.py::test_rename_with_parallel_slow_insert test_rename_column/test.py::test_rename_with_parallel_ttl_delete test_rename_column/test.py::test_rename_with_parallel_ttl_move test_replicated_merge_tree_compatibility/test.py::test_replicated_merge_tree_defaults_compatibility test_replicated_merge_tree_encrypted_disk/test.py::test_different_keys test_replicated_merge_tree_encrypted_disk/test.py::test_same_keys test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl test_replicated_merge_tree_s3_zero_copy/test.py::test_drop_table 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[0-16]' 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[8192-12]' test_replicated_merge_tree_s3_zero_copy/test.py::test_s3_check_restore test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns test_replicated_user_defined_functions/test.py::test_create_and_drop 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[false-expected_raise1]' 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[true-expected_raise0]' test_replicated_user_defined_functions/test.py::test_create_and_replace test_replicated_user_defined_functions/test.py::test_drop_if_exists test_replicated_user_defined_functions/test.py::test_reload_zookeeper test_replicated_user_defined_functions/test.py::test_replication test_replicated_user_defined_functions/test.py::test_replication_replace_by_another_node_after_creation test_replicated_user_defined_functions/test.py::test_server_restart test_replicated_user_defined_functions/test.py::test_start_without_zookeeper test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart test_restore_external_engines/test.py::test_restore_table test_restore_external_engines/test.py::test_restore_table_null test_rocksdb_options/test.py::test_invalid_block_based_table_options test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options test_s3_imds/test_session_token.py::test_credentials_from_metadata test_s3_imds/test_simple.py::test_credentials_from_metadata test_s3_latency_log/test.py::test_latency_log test_s3_low_cardinality_right_border/test.py::test_s3_right_border test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 test_s3_storage_class/test.py::test_s3_storage_class_right 'test_s3_storage_conf_new_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver]' test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy_no_proxy test_scheduler/test.py::test_create_workload test_scheduler/test.py::test_merge_workload test_scheduler/test.py::test_merge_workload_change test_scheduler/test.py::test_merge_workload_override test_scheduler/test.py::test_mutate_workload test_scheduler/test.py::test_mutation_workload_change test_scheduler/test.py::test_mutation_workload_override test_scheduler/test.py::test_resource_any_disk test_scheduler/test.py::test_resource_read_and_write test_scheduler/test.py::test_s3_disk test_scheduler/test.py::test_s3_resource_request_granularity test_scheduler/test.py::test_throw_on_unknown_workload test_scheduler/test.py::test_workload_entity_keeper_storage test_scheduler/test.py::test_workload_hierarchy_changes test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_settings_constraints_distributed/test.py::test_select_clamps_settings -vvv -ss ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge ENV COMPOSE_HTTP_TIMEOUT 600 ENV COMPOSE_HTTP_TIMEOUT 600 ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 get_kazoo_client: zoo3, ip:172.16.9.2, port:2181, use_ssl:False get_kazoo_client: zoo3, ip:172.16.9.2, port:2181, use_ssl:False ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 ENV CLICKHOUSE_USE_OLD_ANALYZER 1 ENV CLICKHOUSE_USE_OLD_ANALYZER 1 ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ENV DOCKER_KERBERIZED_HADOOP_TAG latest ENV DOCKER_KERBERIZED_HADOOP_TAG latest ENV DOCKER_CHANNEL stable ENV DOCKER_CHANNEL stable ENV DOCKER_CLIENT_TIMEOUT 300 ENV DOCKER_CLIENT_TIMEOUT 300 ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False Connecting to 172.16.9.2(172.16.9.2):2181, use_ssl: False ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e ENV PWD /ClickHouse/tests/integration ENV PWD /ClickHouse/tests/integration ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config ENV TZ Etc/UTC ENV TZ Etc/UTC Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java ENV DOCKER_BASE_TAG 8b2301119731 ENV DOCKER_BASE_TAG 8b2301119731 ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 ENV LC_CTYPE C.UTF-8 ENV LC_CTYPE C.UTF-8 ENV INTEGRATION_TESTS_RUN_ID 0 ENV INTEGRATION_TESTS_RUN_ID 0 ENV WORKER_FREE_PORTS 30000 30001 30002 30003 30004 30005 30006 30007 30008 30009 30010 30011 30012 30013 30014 30015 30016 30017 30018 30019 30020 30021 30022 30023 30024 30025 30026 30027 30028 30029 30030 30031 30032 30033 30034 30035 30036 30037 30038 30039 30040 30041 30042 30043 30044 30045 30046 30047 30048 30049 ENV WORKER_FREE_PORTS 30000 30001 30002 30003 30004 30005 30006 30007 30008 30009 30010 30011 30012 30013 30014 30015 30016 30017 30018 30019 30020 30021 30022 30023 30024 30025 30026 30027 30028 30029 30030 30031 30032 30033 30034 30035 30036 30037 30038 30039 30040 30041 30042 30043 30044 30045 30046 30047 30048 30049 ENV PYTEST_XDIST_TESTRUNUID abec1c7124634c26ad4fb6ef8710757d ENV PYTEST_XDIST_TESTRUNUID abec1c7124634c26ad4fb6ef8710757d ENV PYTEST_XDIST_WORKER gw0 ENV PYTEST_XDIST_WORKER gw0 ENV PYTEST_XDIST_WORKER_COUNT 10 ENV PYTEST_XDIST_WORKER_COUNT 10 ENV PYTEST_CURRENT_TEST test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart (setup) ENV PYTEST_CURRENT_TEST test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart (setup) CLUSTER INIT base_config_dir:/clickhouse-config CLUSTER INIT base_config_dir:/clickhouse-config clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log Cluster name: project_name:roottestrestartwithunavailableazure-gw0. Added instance name:node tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/.env', '--project-name', 'roottestrestartwithunavailableazure-gw0', '--file', '/ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Cluster name: project_name:roottestrestartwithunavailableazure-gw0. Added instance name:node tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/.env', '--project-name', 'roottestrestartwithunavailableazure-gw0', '--file', '/ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Running tests in /ClickHouse/tests/integration/test_restart_with_unavailable_azure/test.py Running tests in /ClickHouse/tests/integration/test_restart_with_unavailable_azure/test.py Cluster start called. is_up=False Cluster start called. is_up=False Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost No clickhouse process running. Start new one. No clickhouse process running. Start new one. http://localhost:None "POST /v1.46/containers/roottestsettingsconstraintsdistributed-gw2-distributed-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/roottestsettingsconstraintsdistributed-gw2-distributed-1/exec HTTP/1.1" 201 74 Docker networks for project roottestrestartwithunavailableazure-gw0 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestrestartwithunavailableazure-gw0 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestrestartwithunavailableazure-gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestrestartwithunavailableazure-gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES http://localhost:None "POST /v1.46/exec/88d2387b1ea5876b51476821e2bba8f3a0cbef570bbf49f3c11b88a0d966251b/start HTTP/1.1" 200 0 http://localhost:None "POST /v1.46/exec/88d2387b1ea5876b51476821e2bba8f3a0cbef570bbf49f3c11b88a0d966251b/start HTTP/1.1" 200 0 http://localhost:None "GET /v1.46/exec/88d2387b1ea5876b51476821e2bba8f3a0cbef570bbf49f3c11b88a0d966251b/json HTTP/1.1" 200 586 http://localhost:None "GET /v1.46/exec/88d2387b1ea5876b51476821e2bba8f3a0cbef570bbf49f3c11b88a0d966251b/json HTTP/1.1" 200 586 Docker volumes for project roottestrestartwithunavailableazure-gw0 are DRIVER VOLUME NAME Docker volumes for project roottestrestartwithunavailableazure-gw0 are DRIVER VOLUME NAME Cleanup called Cleanup called http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/3d623a7229f9c546d305d1c043354d2e830a34b825a18c2d604997f9db555ab4/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/3d623a7229f9c546d305d1c043354d2e830a34b825a18c2d604997f9db555ab4/start HTTP/1.1" 101 0 Docker networks for project roottestrestartwithunavailableazure-gw0 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestrestartwithunavailableazure-gw0 are NETWORK ID NAME DRIVER SCOPE Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/.env --project-name roottestreplicatedmergetreecompatibility-gw5 --file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/node2/docker-compose.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/.env --project-name roottestreplicatedmergetreecompatibility-gw5 --file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/node2/docker-compose.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/.env --project-name roottestreplicatedmergetreecompatibility-gw5 --file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/node2/docker-compose.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/.env --project-name roottestreplicatedmergetreecompatibility-gw5 --file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/node2/docker-compose.yml up -d --no-recreate] Docker containers for project roottestrestartwithunavailableazure-gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestrestartwithunavailableazure-gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES run container_id:roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Docker volumes for project roottestrestartwithunavailableazure-gw0 are DRIVER VOLUME NAME Docker volumes for project roottestrestartwithunavailableazure-gw0 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestrestartwithunavailableazure-gw0-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestrestartwithunavailableazure-gw0-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestrestartwithunavailableazure-gw0 No running containers for project: roottestrestartwithunavailableazure-gw0 Trying to prune unused networks... Trying to prune unused networks... Stdout:8 Stdout:8 Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] http://localhost:None "GET /v1.46/exec/3d623a7229f9c546d305d1c043354d2e830a34b825a18c2d604997f9db555ab4/json HTTP/1.1" 200 456 http://localhost:None "GET /v1.46/exec/3d623a7229f9c546d305d1c043354d2e830a34b825a18c2d604997f9db555ab4/json HTTP/1.1" 200 456 [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-d', '172.16.8.9', '--sport', '2181', '-j', 'DROP'] (0): [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-d', '172.16.8.9', '--sport', '2181', '-j', 'DROP'] (0): http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/f3fa3a6b2f52058cae18a38f582269004d51915d10217804c373f1799ffd0145/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/f3fa3a6b2f52058cae18a38f582269004d51915d10217804c373f1799ffd0145/start HTTP/1.1" 101 0 Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:11 Stdout:11 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 11 Volumes pruned: 11 Setup directory for instance: node Setup directory for instance: node Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_restart_with_unavailable_azure/configs/disable_async_loader.xml'] to /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/node/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_restart_with_unavailable_azure/configs/disable_async_loader.xml'] to /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/node/configs/config.d Setup database dir /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/node/database Setup database dir /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/node/database Setup logs dir /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/node/logs Setup logs dir /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/node/logs Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/resolver', 'RESOLVER_LOGS_FS': 'bind', 'AZURITE_PORT': '30000', 'AZURITE_STORAGE_ACCOUNT_URL': 'http://azurite1:30000/devstoreaccount1', 'AZURITE_CONNECTION_STRING': 'DefaultEndpointsProtocol=http;AccountName=devstoreaccount1;AccountKey=Eby8vdM02xNOcqFlqUwJPLlmEtlCDXJ1OUzFT50uSRZ6IFsuFq2UVErCz4I6tq/K1SZFPTOtr/KBHBeksoGMGw==;BlobEndpoint=http://azurite1:30000/devstoreaccount1;'} stored in /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/resolver', 'RESOLVER_LOGS_FS': 'bind', 'AZURITE_PORT': '30000', 'AZURITE_STORAGE_ACCOUNT_URL': 'http://azurite1:30000/devstoreaccount1', 'AZURITE_CONNECTION_STRING': 'DefaultEndpointsProtocol=http;AccountName=devstoreaccount1;AccountKey=Eby8vdM02xNOcqFlqUwJPLlmEtlCDXJ1OUzFT50uSRZ6IFsuFq2UVErCz4I6tq/K1SZFPTOtr/KBHBeksoGMGw==;BlobEndpoint=http://azurite1:30000/devstoreaccount1;'} stored in /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/.env --project-name roottestrestartwithunavailableazure-gw0 --file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/.env --project-name roottestrestartwithunavailableazure-gw0 --file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml pull] Executing query SYSTEM FLUSH LOGS on node Executing query SYSTEM FLUSH LOGS on node http://localhost:None "GET /v1.46/exec/f3fa3a6b2f52058cae18a38f582269004d51915d10217804c373f1799ffd0145/json HTTP/1.1" 200 456 http://localhost:None "GET /v1.46/exec/f3fa3a6b2f52058cae18a38f582269004d51915d10217804c373f1799ffd0145/json HTTP/1.1" 200 456 [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-s', '172.16.8.9', '--dport', '2181', '-j', 'DROP'] (0): [network] a293884c7471231f82f1c67c21b8db7c145a4c9d37fa1998656c058670e146cc: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-s', '172.16.8.9', '--dport', '2181', '-j', 'DROP'] (0): Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node Stderr: Container roottestrestoreexternalengines-gw9-replica3-1 Stopping Stderr: Container roottestrestoreexternalengines-gw9-replica3-1 Stopping Stderr: Container roottestrestoreexternalengines-gw9-replica1-1 Stopping Stderr: Container roottestrestoreexternalengines-gw9-replica1-1 Stopping Stderr: Container roottestrestoreexternalengines-gw9-replica2-1 Stopping Stderr: Container roottestrestoreexternalengines-gw9-replica2-1 Stopping Stderr: Container roottestrestoreexternalengines-gw9-replica3-1 Stopped Stderr: Container roottestrestoreexternalengines-gw9-replica3-1 Stopped Stderr: Container roottestrestoreexternalengines-gw9-replica3-1 Removing Stderr: Container roottestrestoreexternalengines-gw9-replica3-1 Removing Stderr: Container roottestrestoreexternalengines-gw9-replica1-1 Stopped Stderr: Container roottestrestoreexternalengines-gw9-replica1-1 Stopped Stderr: Container roottestrestoreexternalengines-gw9-replica1-1 Removing Stderr: Container roottestrestoreexternalengines-gw9-replica1-1 Removing Stderr: Container roottestrestoreexternalengines-gw9-replica2-1 Stopped Stderr: Container roottestrestoreexternalengines-gw9-replica2-1 Stopped Stderr: Container roottestrestoreexternalengines-gw9-replica2-1 Removing Stderr: Container roottestrestoreexternalengines-gw9-replica2-1 Removing Stderr: Container roottestrestoreexternalengines-gw9-replica1-1 Removed Stderr: Container roottestrestoreexternalengines-gw9-replica1-1 Removed Stderr: Container roottestrestoreexternalengines-gw9-replica2-1 Removed Stderr: Container roottestrestoreexternalengines-gw9-replica2-1 Removed Stderr: Container roottestrestoreexternalengines-gw9-replica3-1 Removed Stderr: Container roottestrestoreexternalengines-gw9-replica3-1 Removed Stderr: Container roottestrestoreexternalengines-gw9-zoo1-1 Stopping Stderr: Container roottestrestoreexternalengines-gw9-zoo1-1 Stopping Stderr: Container roottestrestoreexternalengines-gw9-zoo3-1 Stopping Stderr: Container roottestrestoreexternalengines-gw9-zoo3-1 Stopping Stderr: Container roottestrestoreexternalengines-gw9-mysql80-1 Stopping Stderr: Container roottestrestoreexternalengines-gw9-mysql80-1 Stopping Stderr: Container roottestrestoreexternalengines-gw9-zoo2-1 Stopping Stderr: Container roottestrestoreexternalengines-gw9-zoo2-1 Stopping Stderr: Container roottestrestoreexternalengines-gw9-zoo1-1 Stopped Stderr: Container roottestrestoreexternalengines-gw9-zoo1-1 Stopped Stderr: Container roottestrestoreexternalengines-gw9-zoo1-1 Removing Stderr: Container roottestrestoreexternalengines-gw9-zoo1-1 Removing Stderr: Container roottestrestoreexternalengines-gw9-mysql80-1 Stopped Stderr: Container roottestrestoreexternalengines-gw9-mysql80-1 Stopped Stderr: Container roottestrestoreexternalengines-gw9-mysql80-1 Removing Stderr: Container roottestrestoreexternalengines-gw9-mysql80-1 Removing Stderr: Container roottestrestoreexternalengines-gw9-zoo3-1 Stopped Stderr: Container roottestrestoreexternalengines-gw9-zoo3-1 Stopped Stderr: Container roottestrestoreexternalengines-gw9-zoo3-1 Removing Stderr: Container roottestrestoreexternalengines-gw9-zoo3-1 Removing Stderr: Container roottestrestoreexternalengines-gw9-zoo2-1 Stopped Stderr: Container roottestrestoreexternalengines-gw9-zoo2-1 Stopped Stderr: Container roottestrestoreexternalengines-gw9-zoo2-1 Removing Stderr: Container roottestrestoreexternalengines-gw9-zoo2-1 Removing Stderr: Container roottestrestoreexternalengines-gw9-zoo2-1 Removed Stderr: Container roottestrestoreexternalengines-gw9-zoo2-1 Removed Stderr: Container roottestrestoreexternalengines-gw9-zoo1-1 Removed Stderr: Container roottestrestoreexternalengines-gw9-zoo1-1 Removed Stderr: Container roottestrestoreexternalengines-gw9-zoo3-1 Removed Stderr: Container roottestrestoreexternalengines-gw9-zoo3-1 Removed Stderr: Container roottestrestoreexternalengines-gw9-mysql80-1 Removed Stderr: Container roottestrestoreexternalengines-gw9-mysql80-1 Removed Stderr: Network roottestrestoreexternalengines-gw9_default Removing Stderr: Network roottestrestoreexternalengines-gw9_default Removing Stderr: Network roottestrestoreexternalengines-gw9_default Removed Stderr: Network roottestrestoreexternalengines-gw9_default Removed Cleanup called Cleanup called Docker networks for project roottestrestoreexternalengines-gw9 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestrestoreexternalengines-gw9 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestrestoreexternalengines-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestrestoreexternalengines-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestrestoreexternalengines-gw9 are DRIVER VOLUME NAME Docker volumes for project roottestrestoreexternalengines-gw9 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestrestoreexternalengines-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestrestoreexternalengines-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestrestoreexternalengines-gw9 No running containers for project: roottestrestoreexternalengines-gw9 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:11 Stdout:11 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 11 Volumes pruned: 11 test_remove_stale_moving_parts/test.py::test_remove_stale_moving_parts_without_zookeeper Running tests in /ClickHouse/tests/integration/test_remove_stale_moving_parts/test.py Running tests in /ClickHouse/tests/integration/test_remove_stale_moving_parts/test.py Cluster start called. is_up=False Cluster start called. is_up=False Docker networks for project roottestremovestalemovingparts-gw9 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestremovestalemovingparts-gw9 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestremovestalemovingparts-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestremovestalemovingparts-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo3-1 Running Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo3-1 Running Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo2-1 Running Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo2-1 Running Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo1-1 Running Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo1-1 Running Stderr: Container roottestreplicatedmergetreecompatibility-gw5-node1-1 Creating Stderr: Container roottestreplicatedmergetreecompatibility-gw5-node1-1 Creating Stderr: Container roottestreplicatedmergetreecompatibility-gw5-node2-1 Creating Stderr: Container roottestreplicatedmergetreecompatibility-gw5-node2-1 Creating Stderr: Container roottestreplicatedmergetreecompatibility-gw5-node1-1 Created Stderr: Container roottestreplicatedmergetreecompatibility-gw5-node1-1 Created Stderr: Container roottestreplicatedmergetreecompatibility-gw5-node2-1 Created Stderr: Container roottestreplicatedmergetreecompatibility-gw5-node2-1 Created Stderr: Container roottestreplicatedmergetreecompatibility-gw5-node1-1 Starting Stderr: Container roottestreplicatedmergetreecompatibility-gw5-node1-1 Starting Stderr: Container roottestreplicatedmergetreecompatibility-gw5-node2-1 Starting Stderr: Container roottestreplicatedmergetreecompatibility-gw5-node2-1 Starting Stderr: Container roottestreplicatedmergetreecompatibility-gw5-node2-1 Started Stderr: Container roottestreplicatedmergetreecompatibility-gw5-node2-1 Started Stderr: Container roottestreplicatedmergetreecompatibility-gw5-node1-1 Started Stderr: Container roottestreplicatedmergetreecompatibility-gw5-node1-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node1 get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreecompatibility-gw5-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreecompatibility-gw5-node1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node1 get_instance_ip instance_name=node1 Docker volumes for project roottestremovestalemovingparts-gw9 are DRIVER VOLUME NAME Docker volumes for project roottestremovestalemovingparts-gw9 are DRIVER VOLUME NAME Cleanup called Cleanup called http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreecompatibility-gw5-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreecompatibility-gw5-node1-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node1, ip: 172.16.9.6... Waiting for ClickHouse start in node1, ip: 172.16.9.6... http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreecompatibility-gw5-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreecompatibility-gw5-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/11a0b30424ddff8d81203cb0ae26a29757273502350a7b53889301a29929f0f0/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/11a0b30424ddff8d81203cb0ae26a29757273502350a7b53889301a29929f0f0/json HTTP/1.1" 200 None Docker networks for project roottestremovestalemovingparts-gw9 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestremovestalemovingparts-gw9 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestremovestalemovingparts-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestremovestalemovingparts-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestremovestalemovingparts-gw9 are DRIVER VOLUME NAME Docker volumes for project roottestremovestalemovingparts-gw9 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestremovestalemovingparts-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestremovestalemovingparts-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestremovestalemovingparts-gw9 No running containers for project: roottestremovestalemovingparts-gw9 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] http://localhost:None "GET /v1.46/containers/11a0b30424ddff8d81203cb0ae26a29757273502350a7b53889301a29929f0f0/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/11a0b30424ddff8d81203cb0ae26a29757273502350a7b53889301a29929f0f0/json HTTP/1.1" 200 None Stdout:11 Stdout:11 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 11 Volumes pruned: 11 Setup directory for instance: ch1 Setup directory for instance: ch1 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_remove_stale_moving_parts/config.xml'] to /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/ch1/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_remove_stale_moving_parts/config.xml'] to /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/ch1/configs/config.d Setup database dir /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/ch1/database Setup database dir /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/ch1/database Setup logs dir /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/ch1/logs Setup logs dir /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/ch1/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/keeper3/coordination', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/keeper3/coordination', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/.env --project-name roottestremovestalemovingparts-gw9 --file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/ch1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/.env --project-name roottestremovestalemovingparts-gw9 --file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/ch1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml pull] http://localhost:None "GET /v1.46/containers/11a0b30424ddff8d81203cb0ae26a29757273502350a7b53889301a29929f0f0/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/11a0b30424ddff8d81203cb0ae26a29757273502350a7b53889301a29929f0f0/json HTTP/1.1" 200 None Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node http://localhost:None "GET /v1.46/containers/11a0b30424ddff8d81203cb0ae26a29757273502350a7b53889301a29929f0f0/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/11a0b30424ddff8d81203cb0ae26a29757273502350a7b53889301a29929f0f0/json HTTP/1.1" 200 None run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] http://localhost:None "GET /v1.46/containers/11a0b30424ddff8d81203cb0ae26a29757273502350a7b53889301a29929f0f0/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/11a0b30424ddff8d81203cb0ae26a29757273502350a7b53889301a29929f0f0/json HTTP/1.1" 200 None Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 Stdout:753 Stdout:753 Clickhouse process running. Clickhouse process running. run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query SELECT (LatencyEvent_S3ConnectMicroseconds, LatencyEvent_S3FirstByteWriteAttempt1Microseconds, LatencyEvent_S3FirstByteWriteAttempt2Microseconds, LatencyEvent_S3FirstByteWriteAttemptNMicroseconds) FROM system.latency_log ORDER BY event_time_microseconds DESC LIMIT 1 on node Executing query SELECT (LatencyEvent_S3ConnectMicroseconds, LatencyEvent_S3FirstByteWriteAttempt1Microseconds, LatencyEvent_S3FirstByteWriteAttempt2Microseconds, LatencyEvent_S3FirstByteWriteAttemptNMicroseconds) FROM system.latency_log ORDER BY event_time_microseconds DESC LIMIT 1 on node Stdout:753 Stdout:753 Executing query select 20 on distributed Executing query select 20 on distributed run container_id:roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] http://localhost:None "GET /v1.46/containers/11a0b30424ddff8d81203cb0ae26a29757273502350a7b53889301a29929f0f0/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/11a0b30424ddff8d81203cb0ae26a29757273502350a7b53889301a29929f0f0/json HTTP/1.1" 200 None Stdout:8 Stdout:8 Stdout:738 Stdout:738 http://localhost:None "GET /v1.46/containers/11a0b30424ddff8d81203cb0ae26a29757273502350a7b53889301a29929f0f0/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/11a0b30424ddff8d81203cb0ae26a29757273502350a7b53889301a29929f0f0/json HTTP/1.1" 200 None Executing query WITH (SELECT LatencyEvent_DiskS3ConnectMicroseconds FROM system.latency_buckets) AS buckets SELECT format('[{}]', arrayStringConcat(arrayMap((t, c) -> format('({},{})', toString(t), c), buckets, LatencyEvent_DiskS3ConnectMicroseconds), ',')) FROM system.latency_log ORDER BY event_time_microseconds DESC LIMIT 1 on node Executing query WITH (SELECT LatencyEvent_DiskS3ConnectMicroseconds FROM system.latency_buckets) AS buckets SELECT format('[{}]', arrayStringConcat(arrayMap((t, c) -> format('({},{})', toString(t), c), buckets, LatencyEvent_DiskS3ConnectMicroseconds), ',')) FROM system.latency_log ORDER BY event_time_microseconds DESC LIMIT 1 on node http://localhost:None "GET /v1.46/containers/11a0b30424ddff8d81203cb0ae26a29757273502350a7b53889301a29929f0f0/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/11a0b30424ddff8d81203cb0ae26a29757273502350a7b53889301a29929f0f0/json HTTP/1.1" 200 None Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node http://localhost:None "GET /v1.46/containers/11a0b30424ddff8d81203cb0ae26a29757273502350a7b53889301a29929f0f0/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/11a0b30424ddff8d81203cb0ae26a29757273502350a7b53889301a29929f0f0/json HTTP/1.1" 200 None run container_id:roottests3latencylog-gw4-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://resolver:8080/total'] run container_id:roottests3latencylog-gw4-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://resolver:8080/total'] Command:[docker exec roottests3latencylog-gw4-resolver-1 curl -s http://resolver:8080/total] Command:[docker exec roottests3latencylog-gw4-resolver-1 curl -s http://resolver:8080/total] http://localhost:None "GET /v1.46/containers/11a0b30424ddff8d81203cb0ae26a29757273502350a7b53889301a29929f0f0/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/11a0b30424ddff8d81203cb0ae26a29757273502350a7b53889301a29929f0f0/json HTTP/1.1" 200 None Stdout:1 Stdout:1 run container_id:roottests3latencylog-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'grep -a "Failed to make request to.*resolver:8080.*Timeout: connect timed out" /var/log/clickhouse-server/clickhouse-server.log | wc -l'] run container_id:roottests3latencylog-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'grep -a "Failed to make request to.*resolver:8080.*Timeout: connect timed out" /var/log/clickhouse-server/clickhouse-server.log | wc -l'] Command:[docker exec roottests3latencylog-gw4-node-1 bash -c grep -a "Failed to make request to.*resolver:8080.*Timeout: connect timed out" /var/log/clickhouse-server/clickhouse-server.log | wc -l] Command:[docker exec roottests3latencylog-gw4-node-1 bash -c grep -a "Failed to make request to.*resolver:8080.*Timeout: connect timed out" /var/log/clickhouse-server/clickhouse-server.log | wc -l] Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 Stdout:0 Stdout:0 Latency log before - ([0, 1, 1, 1, 1, 1, 1, 1, 1, 1], [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1], [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0], [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]) Latency log before - ([0, 1, 1, 1, 1, 1, 1, 1, 1, 1], [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1], [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0], [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]) Connect times before - [(100, 0), (1000, 1), (10000, 1), (100000, 1), (200000, 1), (300000, 1), (500000, 1), (1000000, 1), (1500000, 1), (4294967295, 1)] Connect times before - [(100, 0), (1000, 1), (10000, 1), (100000, 1), (200000, 1), (300000, 1), (500000, 1), (1000000, 1), (1500000, 1), (4294967295, 1)] Connection timed out requests count before - 0 Connection timed out requests count before - 0 Resolver requests count before - 1 Resolver requests count before - 1 Executing query INSERT INTO s3_latency_log_test VALUES (1, 'Hello') on node Executing query INSERT INTO s3_latency_log_test VALUES (1, 'Hello') on node http://localhost:None "GET /v1.46/containers/11a0b30424ddff8d81203cb0ae26a29757273502350a7b53889301a29929f0f0/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/11a0b30424ddff8d81203cb0ae26a29757273502350a7b53889301a29929f0f0/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/11a0b30424ddff8d81203cb0ae26a29757273502350a7b53889301a29929f0f0/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/11a0b30424ddff8d81203cb0ae26a29757273502350a7b53889301a29929f0f0/json HTTP/1.1" 200 None Executing query select 20 on distributed Executing query select 20 on distributed http://localhost:None "GET /v1.46/containers/11a0b30424ddff8d81203cb0ae26a29757273502350a7b53889301a29929f0f0/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/11a0b30424ddff8d81203cb0ae26a29757273502350a7b53889301a29929f0f0/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/11a0b30424ddff8d81203cb0ae26a29757273502350a7b53889301a29929f0f0/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/11a0b30424ddff8d81203cb0ae26a29757273502350a7b53889301a29929f0f0/json HTTP/1.1" 200 None Executing query CREATE TABLE sometable_insert (date Date, id UInt32, value Int32) ENGINE = MergeTree() ORDER BY id; on node1 Executing query CREATE TABLE sometable_insert (date Date, id UInt32, value Int32) ENGINE = MergeTree() ORDER BY id; on node1 http://localhost:None "GET /v1.46/containers/11a0b30424ddff8d81203cb0ae26a29757273502350a7b53889301a29929f0f0/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/11a0b30424ddff8d81203cb0ae26a29757273502350a7b53889301a29929f0f0/json HTTP/1.1" 200 None Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node http://localhost:None "GET /v1.46/containers/11a0b30424ddff8d81203cb0ae26a29757273502350a7b53889301a29929f0f0/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/11a0b30424ddff8d81203cb0ae26a29757273502350a7b53889301a29929f0f0/json HTTP/1.1" 200 None run container_id:roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query INSERT INTO sometable_insert VALUES (toDate('2010-01-10'), 1, 1) on node1 Executing query INSERT INTO sometable_insert VALUES (toDate('2010-01-10'), 1, 1) on node1 run container_id:roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] No clickhouse process running. Start new one. No clickhouse process running. Start new one. http://localhost:None "GET /v1.46/containers/11a0b30424ddff8d81203cb0ae26a29757273502350a7b53889301a29929f0f0/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/11a0b30424ddff8d81203cb0ae26a29757273502350a7b53889301a29929f0f0/json HTTP/1.1" 200 None ClickHouse node1 started ClickHouse node1 started get_instance_ip instance_name=node2 get_instance_ip instance_name=node2 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreecompatibility-gw5-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreecompatibility-gw5-node2-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node2 get_instance_ip instance_name=node2 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreecompatibility-gw5-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreecompatibility-gw5-node2-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node2, ip: 172.16.9.5... Waiting for ClickHouse start in node2, ip: 172.16.9.5... http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreecompatibility-gw5-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreecompatibility-gw5-node2-1/json HTTP/1.1" 200 None http://localhost:None "POST /v1.46/containers/roottestpostgresqlreplicadatabaseengine1-gw1-instance-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/roottestpostgresqlreplicadatabaseengine1-gw1-instance-1/exec HTTP/1.1" 201 74 http://localhost:None "GET /v1.46/containers/3709aa8148aff1d6cccc90e0bb45325547354949755c30c6724971a96c5802e7/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3709aa8148aff1d6cccc90e0bb45325547354949755c30c6724971a96c5802e7/json HTTP/1.1" 200 None ClickHouse node2 started ClickHouse node2 started Executing query CREATE DATABASE test ENGINE = Ordinary on node1 Executing query CREATE DATABASE test ENGINE = Ordinary on node1 Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 http://localhost:None "POST /v1.46/exec/62f7d1bd2a61d14f54015e46f8e2a3f94f8c33f1e6e1348f204cb5e69796f7d9/start HTTP/1.1" 200 0 http://localhost:None "POST /v1.46/exec/62f7d1bd2a61d14f54015e46f8e2a3f94f8c33f1e6e1348f204cb5e69796f7d9/start HTTP/1.1" 200 0 http://localhost:None "GET /v1.46/exec/62f7d1bd2a61d14f54015e46f8e2a3f94f8c33f1e6e1348f204cb5e69796f7d9/json HTTP/1.1" 200 586 http://localhost:None "GET /v1.46/exec/62f7d1bd2a61d14f54015e46f8e2a3f94f8c33f1e6e1348f204cb5e69796f7d9/json HTTP/1.1" 200 586 Executing query CREATE TABLE sometable_insert (date Date, id UInt32, value Int32) ENGINE = MergeTree() ORDER BY id; on node2 Executing query CREATE TABLE sometable_insert (date Date, id UInt32, value Int32) ENGINE = MergeTree() ORDER BY id; on node2 Executing query CREATE TABLE test.table ( a UInt32, b String DEFAULT If(a = 0, 'true', 'false'), c String DEFAULT Cast(a, 'String') ) ENGINE = ReplicatedMergeTree('/clickhouse/tables/test/table', 'node1') ORDER BY a on node1 Executing query CREATE TABLE test.table ( a UInt32, b String DEFAULT If(a = 0, 'true', 'false'), c String DEFAULT Cast(a, 'String') ) ENGINE = ReplicatedMergeTree('/clickhouse/tables/test/table', 'node1') ORDER BY a on node1 Executing query INSERT INTO sometable_insert VALUES (toDate('2010-01-10'), 1, 1) on node2 Executing query INSERT INTO sometable_insert VALUES (toDate('2010-01-10'), 1, 1) on node2 Executing query CREATE DATABASE test ENGINE = Ordinary on node2 Executing query CREATE DATABASE test ENGINE = Ordinary on node2 Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node Executing query CREATE TABLE proxy_insert (date Date, id UInt32, value Int32) ENGINE = Distributed(test_cluster, default, sometable_insert, toUInt64(date)); on distributed Executing query CREATE TABLE proxy_insert (date Date, id UInt32, value Int32) ENGINE = Distributed(test_cluster, default, sometable_insert, toUInt64(date)); on distributed Executing query CREATE TABLE test.table ( a UInt32, b String DEFAULT If(a = 0, 'true', 'false'), c String DEFAULT Cast(a, 'String') ) ENGINE = ReplicatedMergeTree('/clickhouse/tables/test/table', 'node2') ORDER BY a on node2 Executing query CREATE TABLE test.table ( a UInt32, b String DEFAULT If(a = 0, 'true', 'false'), c String DEFAULT Cast(a, 'String') ) ENGINE = ReplicatedMergeTree('/clickhouse/tables/test/table', 'node2') ORDER BY a on node2 Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 Executing query ALTER USER shard SETTINGS max_memory_usage = 50000000 MIN 11111111 MAX 99999999 on node1 Executing query ALTER USER shard SETTINGS max_memory_usage = 50000000 MIN 11111111 MAX 99999999 on node1 Executing query DETACH TABLE test.table on node1 Executing query DETACH TABLE test.table on node1 Executing query select name, create_query from system.resources order by all on node Executing query select name, create_query from system.resources order by all on node Executing query ALTER USER shard SETTINGS max_memory_usage = 50000000 MIN 11111111 MAX 99999999 on node2 Executing query ALTER USER shard SETTINGS max_memory_usage = 50000000 MIN 11111111 MAX 99999999 on node2 run container_id:roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:775 Stdout:775 Clickhouse process running. Executing query SYSTEM DROP REPLICA 'node1' FROM TABLE test.table on node2 Clickhouse process running. Executing query SYSTEM DROP REPLICA 'node1' FROM TABLE test.table on node2 run container_id:roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:775 Stdout:775 Executing query select 20 on instance Executing query select 20 on instance Executing query select name, create_query from system.resources order by all on node2 Executing query select name, create_query from system.resources order by all on node2 Executing query INSERT INTO proxy_insert VALUES (toDate('2020-02-20'), 2, 2) on distributed Executing query INSERT INTO proxy_insert VALUES (toDate('2020-02-20'), 2, 2) on distributed run container_id:roottestreplicatedmergetreecompatibility-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'rm /var/lib/clickhouse/metadata/test/table.sql'] run container_id:roottestreplicatedmergetreecompatibility-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'rm /var/lib/clickhouse/metadata/test/table.sql'] Command:[docker exec roottestreplicatedmergetreecompatibility-gw5-node1-1 bash -c rm /var/lib/clickhouse/metadata/test/table.sql] Command:[docker exec roottestreplicatedmergetreecompatibility-gw5-node1-1 bash -c rm /var/lib/clickhouse/metadata/test/table.sql] run container_id:roottestreplicatedmergetreecompatibility-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'rm -r /var/lib/clickhouse/data/test/table'] run container_id:roottestreplicatedmergetreecompatibility-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'rm -r /var/lib/clickhouse/data/test/table'] Command:[docker exec roottestreplicatedmergetreecompatibility-gw5-node1-1 bash -c rm -r /var/lib/clickhouse/data/test/table] Command:[docker exec roottestreplicatedmergetreecompatibility-gw5-node1-1 bash -c rm -r /var/lib/clickhouse/data/test/table] get_instance_ip instance_name=zoo1 get_instance_ip instance_name=zoo1 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreecompatibility-gw5-zoo1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreecompatibility-gw5-zoo1-1/json HTTP/1.1" 200 None get_kazoo_client: zoo1, ip:172.16.9.4, port:2181, use_ssl:False get_kazoo_client: zoo1, ip:172.16.9.4, port:2181, use_ssl:False Connecting to 172.16.9.4(172.16.9.4):2181, use_ssl: False Connecting to 172.16.9.4(172.16.9.4):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): Exists(path='/clickhouse/tables/test/table/replicas/node1', watcher=None) Sending request(xid=1): Exists(path='/clickhouse/tables/test/table/replicas/node1', watcher=None) run container_id:roottestreplicatedmergetreecompatibility-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill -15 clickhouse'] run container_id:roottestreplicatedmergetreecompatibility-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill -15 clickhouse'] Command:[docker exec -u root roottestreplicatedmergetreecompatibility-gw5-node1-1 bash -c pkill -15 clickhouse] Command:[docker exec -u root roottestreplicatedmergetreecompatibility-gw5-node1-1 bash -c pkill -15 clickhouse] Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node run container_id:roottestreplicatedmergetreecompatibility-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicatedmergetreecompatibility-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicatedmergetreecompatibility-gw5-node1-1 bash -c ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicatedmergetreecompatibility-gw5-node1-1 bash -c ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query INSERT INTO proxy_insert VALUES (toDate('2020-02-21'), 2, 2) on distributed Executing query INSERT INTO proxy_insert VALUES (toDate('2020-02-21'), 2, 2) on distributed Stdout:7 Stdout:7 Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node2 Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node2 Executing query SYSTEM FLUSH DISTRIBUTED proxy_insert on distributed Executing query SYSTEM FLUSH DISTRIBUTED proxy_insert on distributed Executing query select 20 on instance Executing query select 20 on instance Executing query SELECT COUNT() FROM proxy_insert on distributed Executing query SELECT COUNT() FROM proxy_insert on distributed [gw3] PASSED test_scheduler/test.py::test_workload_entity_keeper_storage Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node test_scheduler/test.py::test_workload_hierarchy_changes run container_id:roottestreplicatedmergetreecompatibility-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicatedmergetreecompatibility-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicatedmergetreecompatibility-gw5-node1-1 bash -c ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicatedmergetreecompatibility-gw5-node1-1 bash -c ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:7 Stdout:7 run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] [gw2] PASSED test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_settings_constraints_distributed/test.py::test_select_clamps_settings run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] Command:[docker exec -u root roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps -C clickhouse] Command:[docker exec -u root roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps -C clickhouse] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] run container_id:roottestscheduler-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Command:[docker exec roottestscheduler-gw3-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Stdout: PID TTY TIME CMD Stdout: PID TTY TIME CMD Stdout: 753 ? 00:00:02 clickhouse Stdout: 753 ? 00:00:02 clickhouse run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] Command:[docker exec -u root roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c pkill clickhouse] Command:[docker exec -u root roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c pkill clickhouse] Executing query system reload config on node Executing query system reload config on node run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:753 Stdout:753 Executing query select 20 on instance Executing query select 20 on instance Executing query create resource io_write (write disk s3_no_resource); on node Executing query create resource io_write (write disk s3_no_resource); on node run container_id:roottestreplicatedmergetreecompatibility-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicatedmergetreecompatibility-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicatedmergetreecompatibility-gw5-node1-1 bash -c ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicatedmergetreecompatibility-gw5-node1-1 bash -c ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:7 Stdout:7 Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Executing query create resource io_read (read disk s3_no_resource); on node Executing query create resource io_read (read disk s3_no_resource); on node Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance Executing query create workload all; on node Executing query create workload all; on node run container_id:roottestreplicatedmergetreecompatibility-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicatedmergetreecompatibility-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicatedmergetreecompatibility-gw5-node1-1 bash -c ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicatedmergetreecompatibility-gw5-node1-1 bash -c ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] run container_id:roottestreplicatedmergetreecompatibility-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicatedmergetreecompatibility-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicatedmergetreecompatibility-gw5-node1-1 bash -c ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicatedmergetreecompatibility-gw5-node1-1 bash -c ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query create workload X in all settings priority = 0; on node Executing query create workload X in all settings priority = 0; on node run container_id:roottestreplicatedmergetreecompatibility-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /usr/bin/clickhouse /usr/share/clickhouse_original'] run container_id:roottestreplicatedmergetreecompatibility-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /usr/bin/clickhouse /usr/share/clickhouse_original'] Command:[docker exec -u root roottestreplicatedmergetreecompatibility-gw5-node1-1 bash -c cp /usr/bin/clickhouse /usr/share/clickhouse_original] Command:[docker exec -u root roottestreplicatedmergetreecompatibility-gw5-node1-1 bash -c cp /usr/bin/clickhouse /usr/share/clickhouse_original] Executing query select * from `postgres_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_0` order by key; on instance run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:753 Stdout:753 Executing query create workload Y in all settings priority = 1; on node Executing query create workload Y in all settings priority = 1; on node Executing query create resource io_test (write disk non_existent_disk, read disk non_existent_disk); on node Executing query create resource io_test (write disk non_existent_disk, read disk non_existent_disk); on node Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance run container_id:roottestreplicatedmergetreecompatibility-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /usr/share/clickhouse_fresh /usr/bin/clickhouse && chmod 777 /usr/bin/clickhouse'] run container_id:roottestreplicatedmergetreecompatibility-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /usr/share/clickhouse_fresh /usr/bin/clickhouse && chmod 777 /usr/bin/clickhouse'] Command:[docker exec -u root roottestreplicatedmergetreecompatibility-gw5-node1-1 bash -c cp /usr/share/clickhouse_fresh /usr/bin/clickhouse && chmod 777 /usr/bin/clickhouse] Command:[docker exec -u root roottestreplicatedmergetreecompatibility-gw5-node1-1 bash -c cp /usr/share/clickhouse_fresh /usr/bin/clickhouse && chmod 777 /usr/bin/clickhouse] Executing query drop resource io_test; on node Executing query drop resource io_test; on node Executing query SELECT * FROM `test_database`.`postgresql_replica_1` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_1` LIMIT 1 FORMAT Null on instance Executing query create workload A1 in X settings priority = -1; on node Executing query create workload A1 in X settings priority = -1; on node Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_1' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_1' on instance Executing query create workload B1 in X settings priority = 1; on node Executing query create workload B1 in X settings priority = 1; on node run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query select * from `postgres_database`.`postgresql_replica_1` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_1` order by key; on instance Executing query create workload C1 in Y settings priority = -1; on node Executing query create workload C1 in Y settings priority = -1; on node Stdout:753 Stdout:753 Executing query create workload D1 in Y settings priority = 1; on node Executing query create workload D1 in Y settings priority = 1; on node Executing query select * from `test_database`.`postgresql_replica_1` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_1` order by key; on instance Executing query create workload A2 in X settings priority = -1; on node Executing query create workload A2 in X settings priority = -1; on node Executing query create workload B2 in X settings priority = 1; on node Executing query create workload B2 in X settings priority = 1; on node Executing query SELECT * FROM `test_database`.`postgresql_replica_2` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_2` LIMIT 1 FORMAT Null on instance Executing query create workload C2 in Y settings priority = -1; on node Executing query create workload C2 in Y settings priority = -1; on node Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_2' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_2' on instance Executing query create workload D2 in Y settings priority = 1; on node Executing query create workload D2 in Y settings priority = 1; on node Executing query select * from `postgres_database`.`postgresql_replica_2` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_2` order by key; on instance run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query drop workload A1; on node Executing query drop workload A1; on node Stdout:753 Stdout:753 Executing query select * from `test_database`.`postgresql_replica_2` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_2` order by key; on instance Executing query drop workload A2; on node Executing query drop workload A2; on node Executing query drop workload B1; on node Executing query drop workload B1; on node Executing query SELECT * FROM `test_database`.`postgresql_replica_3` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_3` LIMIT 1 FORMAT Null on instance Executing query drop workload B2; on node Executing query drop workload B2; on node Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_3' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_3' on instance Executing query drop workload C1; on node Executing query drop workload C1; on node Executing query select * from `postgres_database`.`postgresql_replica_3` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_3` order by key; on instance Executing query drop workload C2; on node Executing query drop workload C2; on node run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:753 Stdout:753 Executing query drop workload D1; on node Executing query drop workload D1; on node Executing query select * from `test_database`.`postgresql_replica_3` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_3` order by key; on instance Executing query drop workload D2; on node Executing query drop workload D2; on node Executing query SELECT * FROM `test_database`.`postgresql_replica_4` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_4` LIMIT 1 FORMAT Null on instance Executing query create workload Z in all; on node Executing query create workload Z in all; on node Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_4' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_4' on instance Executing query create workload A1 in Z settings priority = -1; on node Executing query create workload A1 in Z settings priority = -1; on node Executing query select * from `postgres_database`.`postgresql_replica_4` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_4` order by key; on instance Executing query create workload A2 in Z settings priority = -1; on node Executing query create workload A2 in Z settings priority = -1; on node run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] No clickhouse process running. Start new one. No clickhouse process running. Start new one. http://localhost:None "POST /v1.46/containers/roottestsettingsconstraintsdistributed-gw2-distributed-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/roottestsettingsconstraintsdistributed-gw2-distributed-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/eb8f02deae60a5d7b43c4b9dc4d769f3e0b17a41c75bbcb8b56793c204836907/start HTTP/1.1" 200 0 http://localhost:None "POST /v1.46/exec/eb8f02deae60a5d7b43c4b9dc4d769f3e0b17a41c75bbcb8b56793c204836907/start HTTP/1.1" 200 0 http://localhost:None "GET /v1.46/exec/eb8f02deae60a5d7b43c4b9dc4d769f3e0b17a41c75bbcb8b56793c204836907/json HTTP/1.1" 200 586 http://localhost:None "GET /v1.46/exec/eb8f02deae60a5d7b43c4b9dc4d769f3e0b17a41c75bbcb8b56793c204836907/json HTTP/1.1" 200 586 Executing query select * from `test_database`.`postgresql_replica_4` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_4` order by key; on instance Executing query create workload A3 in Z settings priority = -1; on node Executing query create workload A3 in Z settings priority = -1; on node Executing query create workload B1 in Z settings priority = 1; on node Executing query create workload B1 in Z settings priority = 1; on node Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance [gw1] PASSED test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished run container_id:roottestreloadclustersconfig-gw7-node-1 detach:False nothrow:False cmd: ['bash', '-c', "echo '\n\n \n \n \n true\n \n node_1\n 9000\n \n \n node_2\n 9000\n \n \n \n \n \n true\n \n node_1\n 9000\n \n \n node_2\n 9000\n \n \n \n \n\n' > /etc/clickhouse-server/config.d/remote_servers.xml"] run container_id:roottestreloadclustersconfig-gw7-node-1 detach:False nothrow:False cmd: ['bash', '-c', "echo '\n\n \n \n \n true\n \n node_1\n 9000\n \n \n node_2\n 9000\n \n \n \n \n \n true\n \n node_1\n 9000\n \n \n node_2\n 9000\n \n \n \n \n\n' > /etc/clickhouse-server/config.d/remote_servers.xml"] Command:[docker exec roottestreloadclustersconfig-gw7-node-1 bash -c echo ' true node_1 9000 node_2 9000 true node_1 9000 node_2 9000 ' > /etc/clickhouse-server/config.d/remote_servers.xml] Command:[docker exec roottestreloadclustersconfig-gw7-node-1 bash -c echo ' true node_1 9000 node_2 9000 true node_1 9000 node_2 9000 ' > /etc/clickhouse-server/config.d/remote_servers.xml] Executing query SYSTEM RELOAD CONFIG on node Executing query SYSTEM RELOAD CONFIG on node Executing query create workload B2 in Z settings priority = 1; on node Executing query create workload B2 in Z settings priority = 1; on node Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance [gw7] PASSED test_reload_clusters_config/test.py::test_add_cluster test_reload_clusters_config/test.py::test_delete_cluster Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query create workload B3 in Z settings priority = 1; on node Executing query create workload B3 in Z settings priority = 1; on node Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query create workload C1 in X settings priority = -1; on node Executing query create workload C1 in X settings priority = -1; on node Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:1566 Stdout:1566 Clickhouse process running. Clickhouse process running. run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query create workload C2 in X settings priority = -1; on node Executing query create workload C2 in X settings priority = -1; on node Stdout:1566 Stdout:1566 Executing query select 20 on distributed Executing query select 20 on distributed test_postgresql_replica_database_engine_1/test.py::test_single_transaction Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query create workload C3 in X settings priority = -1; on node Executing query create workload C3 in X settings priority = -1; on node Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query create workload D1 in X settings priority = 1; on node Executing query create workload D1 in X settings priority = 1; on node Stderr: zoo1 Skipped - Image is already being pulled by zoo3 Stderr: zoo1 Skipped - Image is already being pulled by zoo3 Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: ch1 Skipped - Image is already being pulled by zoo3 Stderr: ch1 Skipped - Image is already being pulled by zoo3 Stderr: zoo2 Skipped - Image is already being pulled by zoo3 Stderr: zoo2 Skipped - Image is already being pulled by zoo3 Stderr: zoo3 Pulling Stderr: zoo3 Pulling Stderr: proxy1 Pulling Stderr: proxy1 Pulling Stderr: minio1 Pulling Stderr: minio1 Pulling Stderr: resolver Pulling Stderr: resolver Pulling Stderr: zoo3 Pulled Stderr: zoo3 Pulled Stderr: minio1 Pulled Stderr: minio1 Pulled Stderr: proxy1 Pulled Stderr: proxy1 Pulled Stderr: resolver Pulled Stderr: resolver Pulled Setup ZooKeeper Setup ZooKeeper Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/keeper1/log', '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/keeper1/config', '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/keeper1/coordination', '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/keeper2/log', '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/keeper2/config', '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/keeper2/coordination', '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/keeper3/log', '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/keeper3/config', '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/keeper3/coordination'] Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/keeper1/log', '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/keeper1/config', '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/keeper1/coordination', '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/keeper2/log', '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/keeper2/config', '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/keeper2/coordination', '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/keeper3/log', '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/keeper3/config', '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/keeper3/coordination'] Command:[docker compose --project-name roottestremovestalemovingparts-gw9 --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Command:[docker compose --project-name roottestremovestalemovingparts-gw9 --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Executing query SHOW DATABASES on instance Executing query SHOW DATABASES on instance Executing query create workload D2 in X settings priority = 1; on node Executing query create workload D2 in X settings priority = 1; on node Executing query select 20 on distributed Executing query select 20 on distributed Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Executing query create workload D3 in X settings priority = 1; on node Executing query create workload D3 in X settings priority = 1; on node Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance Executing query CREATE TABLE sometable_select (date Date, id UInt32, value Int32) ENGINE = MergeTree() ORDER BY id; on node1 Executing query CREATE TABLE sometable_select (date Date, id UInt32, value Int32) ENGINE = MergeTree() ORDER BY id; on node1 Executing query drop workload A1; on node Executing query drop workload A1; on node Executing query INSERT INTO sometable_select VALUES (toDate('2010-01-10'), 1, 1) on node1 Executing query INSERT INTO sometable_select VALUES (toDate('2010-01-10'), 1, 1) on node1 Executing query drop workload B1; on node Executing query drop workload B1; on node Executing query CREATE TABLE sometable_select (date Date, id UInt32, value Int32) ENGINE = MergeTree() ORDER BY id; on node2 Executing query CREATE TABLE sometable_select (date Date, id UInt32, value Int32) ENGINE = MergeTree() ORDER BY id; on node2 Stderr:time="2025-04-02T02:55:26Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:55:26Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottestremovestalemovingparts-gw9_default Creating Stderr: Network roottestremovestalemovingparts-gw9_default Creating Stderr: Network roottestremovestalemovingparts-gw9_default Created Stderr: Network roottestremovestalemovingparts-gw9_default Created Stderr: Container roottestremovestalemovingparts-gw9-zoo1-1 Creating Stderr: Container roottestremovestalemovingparts-gw9-zoo1-1 Creating Stderr: Container roottestremovestalemovingparts-gw9-zoo3-1 Creating Stderr: Container roottestremovestalemovingparts-gw9-zoo3-1 Creating Stderr: Container roottestremovestalemovingparts-gw9-zoo2-1 Creating Stderr: Container roottestremovestalemovingparts-gw9-zoo2-1 Creating Stderr: Container roottestremovestalemovingparts-gw9-zoo1-1 Created Stderr: Container roottestremovestalemovingparts-gw9-zoo1-1 Created Stderr: Container roottestremovestalemovingparts-gw9-zoo3-1 Created Stderr: Container roottestremovestalemovingparts-gw9-zoo3-1 Created Stderr: Container roottestremovestalemovingparts-gw9-zoo2-1 Created Stderr: Container roottestremovestalemovingparts-gw9-zoo2-1 Created Stderr: Container roottestremovestalemovingparts-gw9-zoo2-1 Starting Stderr: Container roottestremovestalemovingparts-gw9-zoo2-1 Starting Stderr: Container roottestremovestalemovingparts-gw9-zoo3-1 Starting Stderr: Container roottestremovestalemovingparts-gw9-zoo3-1 Starting Stderr: Container roottestremovestalemovingparts-gw9-zoo1-1 Starting Stderr: Container roottestremovestalemovingparts-gw9-zoo1-1 Starting Stderr: Container roottestremovestalemovingparts-gw9-zoo2-1 Started Stderr: Container roottestremovestalemovingparts-gw9-zoo2-1 Started Stderr: Container roottestremovestalemovingparts-gw9-zoo1-1 Started Stderr: Container roottestremovestalemovingparts-gw9-zoo1-1 Started Stderr: Container roottestremovestalemovingparts-gw9-zoo3-1 Started Stderr: Container roottestremovestalemovingparts-gw9-zoo3-1 Started Stderr:time="2025-04-02T02:55:27Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:55:27Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:55:27Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:55:27Z" level=debug msg="otel error" error="" Wait ZooKeeper to start Wait ZooKeeper to start get_instance_ip instance_name=zoo1 get_instance_ip instance_name=zoo1 http://localhost:None "GET /v1.46/containers/roottestremovestalemovingparts-gw9-zoo1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestremovestalemovingparts-gw9-zoo1-1/json HTTP/1.1" 200 None get_kazoo_client: zoo1, ip:172.16.1.4, port:2181, use_ssl:False get_kazoo_client: zoo1, ip:172.16.1.4, port:2181, use_ssl:False Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused run container_id:roottestreplicatedmergetreecompatibility-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "echo 'restart_with_latest_version: From version' && /usr/share/clickhouse_original server --version && echo 'To version' /usr/share/clickhouse_fresh server --version"] run container_id:roottestreplicatedmergetreecompatibility-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "echo 'restart_with_latest_version: From version' && /usr/share/clickhouse_original server --version && echo 'To version' /usr/share/clickhouse_fresh server --version"] Command:[docker exec roottestreplicatedmergetreecompatibility-gw5-node1-1 bash -c echo 'restart_with_latest_version: From version' && /usr/share/clickhouse_original server --version && echo 'To version' /usr/share/clickhouse_fresh server --version] Command:[docker exec roottestreplicatedmergetreecompatibility-gw5-node1-1 bash -c echo 'restart_with_latest_version: From version' && /usr/share/clickhouse_original server --version && echo 'To version' /usr/share/clickhouse_fresh server --version] Stdout:restart_with_latest_version: From version Stdout:restart_with_latest_version: From version Stdout:ClickHouse server version 23.3.22.3 (official build). Stdout:ClickHouse server version 23.3.22.3 (official build). Stdout:To version /usr/share/clickhouse_fresh server --version Stdout:To version /usr/share/clickhouse_fresh server --version run container_id:roottestreplicatedmergetreecompatibility-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- '] run container_id:roottestreplicatedmergetreecompatibility-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- '] Command:[docker exec -u 0 roottestreplicatedmergetreecompatibility-gw5-node1-1 bash -c clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ] Command:[docker exec -u 0 roottestreplicatedmergetreecompatibility-gw5-node1-1 bash -c clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ] Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query drop workload C1; on node Executing query drop workload C1; on node Executing query INSERT INTO sometable_select VALUES (toDate('2010-01-10'), 1, 1) on node2 Executing query INSERT INTO sometable_select VALUES (toDate('2010-01-10'), 1, 1) on node2 Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused run container_id:roottestreplicatedmergetreecompatibility-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicatedmergetreecompatibility-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicatedmergetreecompatibility-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicatedmergetreecompatibility-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:389 Stdout:389 Executing query select 20 on node1 Executing query select 20 on node1 Executing query drop workload D1; on node Executing query drop workload D1; on node Executing query CREATE TABLE proxy_select (date Date, id UInt32, value Int32) ENGINE = Distributed(test_cluster, default, sometable_select, toUInt64(date)); on distributed Executing query CREATE TABLE proxy_select (date Date, id UInt32, value Int32) ENGINE = Distributed(test_cluster, default, sometable_select, toUInt64(date)); on distributed Stderr: Container roottests3storageconfproxy-gw6-resolver-1 Stopping Stderr: Container roottests3storageconfproxy-gw6-resolver-1 Stopping Stderr: Container roottests3storageconfproxy-gw6-node-1 Stopping Stderr: Container roottests3storageconfproxy-gw6-node-1 Stopping Stderr: Container roottests3storageconfproxy-gw6-node-1 Stopped Stderr: Container roottests3storageconfproxy-gw6-node-1 Stopped Stderr: Container roottests3storageconfproxy-gw6-minio1-1 Stopping Stderr: Container roottests3storageconfproxy-gw6-minio1-1 Stopping Stderr: Container roottests3storageconfproxy-gw6-minio1-1 Stopped Stderr: Container roottests3storageconfproxy-gw6-minio1-1 Stopped Stderr: Container roottests3storageconfproxy-gw6-resolver-1 Stopped Stderr: Container roottests3storageconfproxy-gw6-resolver-1 Stopped Stderr: Container roottests3storageconfproxy-gw6-proxy2-1 Stopping Stderr: Container roottests3storageconfproxy-gw6-proxy2-1 Stopping Stderr: Container roottests3storageconfproxy-gw6-proxy1-1 Stopping Stderr: Container roottests3storageconfproxy-gw6-proxy1-1 Stopping Stderr: Container roottests3storageconfproxy-gw6-proxy1-1 Stopped Stderr: Container roottests3storageconfproxy-gw6-proxy1-1 Stopped Stderr: Container roottests3storageconfproxy-gw6-proxy2-1 Stopped Stderr: Container roottests3storageconfproxy-gw6-proxy2-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/.env --project-name roottests3storageconfproxy-gw6 --file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/.env --project-name roottests3storageconfproxy-gw6 --file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml down --volumes] Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query drop workload A2; on node Executing query drop workload A2; on node Executing query CREATE USER normal DEFAULT ROLE admin SETTINGS max_memory_usage = 80000000 on distributed Executing query CREATE USER normal DEFAULT ROLE admin SETTINGS max_memory_usage = 80000000 on distributed Executing query drop workload B2; on node Executing query drop workload B2; on node Executing query CREATE USER wasteful DEFAULT ROLE admin SETTINGS max_memory_usage = 2000000000 on distributed Executing query CREATE USER wasteful DEFAULT ROLE admin SETTINGS max_memory_usage = 2000000000 on distributed Executing query select 20 on node1 Executing query select 20 on node1 Executing query CREATE USER readonly DEFAULT ROLE admin SETTINGS readonly = 1 on distributed Executing query CREATE USER readonly DEFAULT ROLE admin SETTINGS readonly = 1 on distributed Executing query drop workload C2; on node Executing query drop workload C2; on node Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query ALTER USER shard SETTINGS max_memory_usage = 50000000 MIN 11111111 MAX 99999999 on node1 Executing query ALTER USER shard SETTINGS max_memory_usage = 50000000 MIN 11111111 MAX 99999999 on node1 Stderr: Container roottests3storageconfproxy-gw6-node-1 Stopping Stderr: Container roottests3storageconfproxy-gw6-node-1 Stopping Stderr: Container roottests3storageconfproxy-gw6-resolver-1 Stopping Stderr: Container roottests3storageconfproxy-gw6-resolver-1 Stopping Stderr: Container roottests3storageconfproxy-gw6-node-1 Stopped Stderr: Container roottests3storageconfproxy-gw6-node-1 Stopped Stderr: Container roottests3storageconfproxy-gw6-node-1 Removing Stderr: Container roottests3storageconfproxy-gw6-node-1 Removing Stderr: Container roottests3storageconfproxy-gw6-resolver-1 Stopped Stderr: Container roottests3storageconfproxy-gw6-resolver-1 Stopped Stderr: Container roottests3storageconfproxy-gw6-resolver-1 Removing Stderr: Container roottests3storageconfproxy-gw6-resolver-1 Removing Stderr: Container roottests3storageconfproxy-gw6-node-1 Removed Stderr: Container roottests3storageconfproxy-gw6-node-1 Removed Stderr: Container roottests3storageconfproxy-gw6-minio1-1 Stopping Stderr: Container roottests3storageconfproxy-gw6-minio1-1 Stopping Stderr: Container roottests3storageconfproxy-gw6-minio1-1 Stopped Stderr: Container roottests3storageconfproxy-gw6-minio1-1 Stopped Stderr: Container roottests3storageconfproxy-gw6-minio1-1 Removing Stderr: Container roottests3storageconfproxy-gw6-minio1-1 Removing Stderr: Container roottests3storageconfproxy-gw6-resolver-1 Removed Stderr: Container roottests3storageconfproxy-gw6-resolver-1 Removed Stderr: Container roottests3storageconfproxy-gw6-minio1-1 Removed Stderr: Container roottests3storageconfproxy-gw6-minio1-1 Removed Stderr: Container roottests3storageconfproxy-gw6-proxy1-1 Stopping Stderr: Container roottests3storageconfproxy-gw6-proxy1-1 Stopping Stderr: Container roottests3storageconfproxy-gw6-proxy2-1 Stopping Stderr: Container roottests3storageconfproxy-gw6-proxy2-1 Stopping Stderr: Container roottests3storageconfproxy-gw6-proxy1-1 Stopped Stderr: Container roottests3storageconfproxy-gw6-proxy1-1 Stopped Stderr: Container roottests3storageconfproxy-gw6-proxy1-1 Removing Stderr: Container roottests3storageconfproxy-gw6-proxy1-1 Removing Stderr: Container roottests3storageconfproxy-gw6-proxy2-1 Stopped Stderr: Container roottests3storageconfproxy-gw6-proxy2-1 Stopped Stderr: Container roottests3storageconfproxy-gw6-proxy2-1 Removing Stderr: Container roottests3storageconfproxy-gw6-proxy2-1 Removing Stderr: Container roottests3storageconfproxy-gw6-proxy1-1 Removed Stderr: Container roottests3storageconfproxy-gw6-proxy1-1 Removed Stderr: Container roottests3storageconfproxy-gw6-proxy2-1 Removed Stderr: Container roottests3storageconfproxy-gw6-proxy2-1 Removed Stderr: Volume roottests3storageconfproxy-gw6_data1-1 Removing Stderr: Volume roottests3storageconfproxy-gw6_data1-1 Removing Stderr: Network roottests3storageconfproxy-gw6_default Removing Stderr: Network roottests3storageconfproxy-gw6_default Removing Stderr: Volume roottests3storageconfproxy-gw6_data1-1 Removed Stderr: Volume roottests3storageconfproxy-gw6_data1-1 Removed Stderr: Network roottests3storageconfproxy-gw6_default Removed Stderr: Network roottests3storageconfproxy-gw6_default Removed Cleanup called Cleanup called Docker networks for project roottests3storageconfproxy-gw6 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3storageconfproxy-gw6 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3storageconfproxy-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3storageconfproxy-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Executing query drop workload D2; on node Executing query drop workload D2; on node Docker volumes for project roottests3storageconfproxy-gw6 are DRIVER VOLUME NAME Docker volumes for project roottests3storageconfproxy-gw6 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottests3storageconfproxy-gw6-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottests3storageconfproxy-gw6-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottests3storageconfproxy-gw6 No running containers for project: roottests3storageconfproxy-gw6 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Executing query ALTER USER shard SETTINGS readonly = 1 on node2 Executing query ALTER USER shard SETTINGS readonly = 1 on node2 Stdout:9 Stdout:9 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 9 Volumes pruned: 9 test_s3_imds/test_simple.py::test_credentials_from_metadata Running tests in /ClickHouse/tests/integration/test_s3_imds/test_simple.py Running tests in /ClickHouse/tests/integration/test_s3_imds/test_simple.py Cluster start called. is_up=False Cluster start called. is_up=False Docker networks for project roottests3imdssimple-gw6 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3imdssimple-gw6 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3imdssimple-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3imdssimple-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3imdssimple-gw6 are DRIVER VOLUME NAME Docker volumes for project roottests3imdssimple-gw6 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker networks for project roottests3imdssimple-gw6 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3imdssimple-gw6 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3imdssimple-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3imdssimple-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3imdssimple-gw6 are DRIVER VOLUME NAME Docker volumes for project roottests3imdssimple-gw6 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottests3imdssimple-gw6-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottests3imdssimple-gw6-.*-1$' --format '{{.ID}}:{{.Names}}'] Executing query drop workload A3; on node Executing query drop workload A3; on node Unstopped containers: {} Unstopped containers: {} No running containers for project: roottests3imdssimple-gw6 No running containers for project: roottests3imdssimple-gw6 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:9 Stdout:9 Command:[docker volume prune -f] Command:[docker volume prune -f] Executing query SELECT COUNT() FROM proxy_select on distributed Executing query SELECT COUNT() FROM proxy_select on distributed Executing query select 20 on node1 Executing query select 20 on node1 Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 9 Volumes pruned: 9 Setup directory for instance: node Setup directory for instance: node Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_s3_imds/configs/use_environment_credentials.xml'] to /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/node/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_s3_imds/configs/use_environment_credentials.xml'] to /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/node/configs/config.d Setup database dir /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/node/database Setup database dir /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/node/database Setup logs dir /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/node/logs Setup logs dir /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/node/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'AWS_EC2_METADATA_SERVICE_ENDPOINT': 'resolver:8080', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'AWS_EC2_METADATA_SERVICE_ENDPOINT': 'resolver:8080', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/.env --project-name roottests3imdssimple-gw6 --file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/.env --project-name roottests3imdssimple-gw6 --file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml pull] Executing query drop workload B3; on node Executing query drop workload B3; on node run container_id:roottestreplicatedmergetreecompatibility-gw5-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill -15 clickhouse'] run container_id:roottestreplicatedmergetreecompatibility-gw5-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill -15 clickhouse'] Command:[docker exec -u root roottestreplicatedmergetreecompatibility-gw5-node2-1 bash -c pkill -15 clickhouse] Command:[docker exec -u root roottestreplicatedmergetreecompatibility-gw5-node2-1 bash -c pkill -15 clickhouse] Executing query SELECT COUNT() FROM proxy_select on distributed Executing query SELECT COUNT() FROM proxy_select on distributed run container_id:roottestreplicatedmergetreecompatibility-gw5-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicatedmergetreecompatibility-gw5-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicatedmergetreecompatibility-gw5-node2-1 bash -c ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicatedmergetreecompatibility-gw5-node2-1 bash -c ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:8 Stdout:8 Executing query drop workload C3; on node Executing query drop workload C3; on node Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query SELECT COUNT() FROM proxy_select on distributed Executing query SELECT COUNT() FROM proxy_select on distributed Executing query drop workload D3; on node Executing query drop workload D3; on node Executing query drop workload X; on node Executing query drop workload X; on node Executing query SELECT COUNT() FROM proxy_select on distributed Executing query SELECT COUNT() FROM proxy_select on distributed run container_id:roottestreplicatedmergetreecompatibility-gw5-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicatedmergetreecompatibility-gw5-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicatedmergetreecompatibility-gw5-node2-1 bash -c ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicatedmergetreecompatibility-gw5-node2-1 bash -c ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:8 Stdout:8 Executing query SYSTEM FLUSH LOGS on node Executing query SYSTEM FLUSH LOGS on node Executing query drop workload Y; on node Executing query drop workload Y; on node Executing query SELECT COUNT() FROM proxy_select on distributed Executing query SELECT COUNT() FROM proxy_select on distributed Executing query drop workload Z; on node Executing query drop workload Z; on node Executing query SELECT COUNT() FROM proxy_select on distributed Executing query SELECT COUNT() FROM proxy_select on distributed Executing query drop workload all; on node Executing query drop workload all; on node run container_id:roottestreplicatedmergetreecompatibility-gw5-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicatedmergetreecompatibility-gw5-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicatedmergetreecompatibility-gw5-node2-1 bash -c ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicatedmergetreecompatibility-gw5-node2-1 bash -c ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query create workload all; on node Executing query create workload all; on node Executing query SELECT COUNT() FROM remote('node{1,2}', 'default', 'sometable_select') on distributed Executing query SELECT COUNT() FROM remote('node{1,2}', 'default', 'sometable_select') on distributed run container_id:roottestreplicatedmergetreecompatibility-gw5-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicatedmergetreecompatibility-gw5-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicatedmergetreecompatibility-gw5-node2-1 bash -c ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicatedmergetreecompatibility-gw5-node2-1 bash -c ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] run container_id:roottestreplicatedmergetreecompatibility-gw5-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /usr/bin/clickhouse /usr/share/clickhouse_original'] run container_id:roottestreplicatedmergetreecompatibility-gw5-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /usr/bin/clickhouse /usr/share/clickhouse_original'] Command:[docker exec -u root roottestreplicatedmergetreecompatibility-gw5-node2-1 bash -c cp /usr/bin/clickhouse /usr/share/clickhouse_original] Command:[docker exec -u root roottestreplicatedmergetreecompatibility-gw5-node2-1 bash -c cp /usr/bin/clickhouse /usr/share/clickhouse_original] Executing query SELECT (LatencyEvent_S3ConnectMicroseconds, LatencyEvent_S3FirstByteWriteAttempt1Microseconds, LatencyEvent_S3FirstByteWriteAttempt2Microseconds, LatencyEvent_S3FirstByteWriteAttemptNMicroseconds) FROM system.latency_log ORDER BY event_time_microseconds DESC LIMIT 1 on node Executing query SELECT (LatencyEvent_S3ConnectMicroseconds, LatencyEvent_S3FirstByteWriteAttempt1Microseconds, LatencyEvent_S3FirstByteWriteAttempt2Microseconds, LatencyEvent_S3FirstByteWriteAttemptNMicroseconds) FROM system.latency_log ORDER BY event_time_microseconds DESC LIMIT 1 on node Executing query create workload X in all settings priority = 0; on node Executing query create workload X in all settings priority = 0; on node Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Executing query SELECT COUNT() FROM remote('node{1,2}', 'default', 'sometable_select') on distributed Executing query SELECT COUNT() FROM remote('node{1,2}', 'default', 'sometable_select') on distributed Executing query WITH (SELECT LatencyEvent_DiskS3ConnectMicroseconds FROM system.latency_buckets) AS buckets SELECT format('[{}]', arrayStringConcat(arrayMap((t, c) -> format('({},{})', toString(t), c), buckets, LatencyEvent_DiskS3ConnectMicroseconds), ',')) FROM system.latency_log ORDER BY event_time_microseconds DESC LIMIT 1 on node Executing query WITH (SELECT LatencyEvent_DiskS3ConnectMicroseconds FROM system.latency_buckets) AS buckets SELECT format('[{}]', arrayStringConcat(arrayMap((t, c) -> format('({},{})', toString(t), c), buckets, LatencyEvent_DiskS3ConnectMicroseconds), ',')) FROM system.latency_log ORDER BY event_time_microseconds DESC LIMIT 1 on node Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo2 get_instance_ip instance_name=zoo2 http://localhost:None "GET /v1.46/containers/roottestremovestalemovingparts-gw9-zoo2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestremovestalemovingparts-gw9-zoo2-1/json HTTP/1.1" 200 None get_kazoo_client: zoo2, ip:172.16.1.2, port:2181, use_ssl:False get_kazoo_client: zoo2, ip:172.16.1.2, port:2181, use_ssl:False Connecting to 172.16.1.2(172.16.1.2):2181, use_ssl: False Connecting to 172.16.1.2(172.16.1.2):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Executing query create workload Y in all settings priority = 1; on node Executing query create workload Y in all settings priority = 1; on node run container_id:roottestreplicatedmergetreecompatibility-gw5-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /usr/share/clickhouse_fresh /usr/bin/clickhouse && chmod 777 /usr/bin/clickhouse'] run container_id:roottestreplicatedmergetreecompatibility-gw5-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /usr/share/clickhouse_fresh /usr/bin/clickhouse && chmod 777 /usr/bin/clickhouse'] Command:[docker exec -u root roottestreplicatedmergetreecompatibility-gw5-node2-1 bash -c cp /usr/share/clickhouse_fresh /usr/bin/clickhouse && chmod 777 /usr/bin/clickhouse] Command:[docker exec -u root roottestreplicatedmergetreecompatibility-gw5-node2-1 bash -c cp /usr/share/clickhouse_fresh /usr/bin/clickhouse && chmod 777 /usr/bin/clickhouse] Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo3 get_instance_ip instance_name=zoo3 http://localhost:None "GET /v1.46/containers/roottestremovestalemovingparts-gw9-zoo3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestremovestalemovingparts-gw9-zoo3-1/json HTTP/1.1" 200 None get_kazoo_client: zoo3, ip:172.16.1.3, port:2181, use_ssl:False get_kazoo_client: zoo3, ip:172.16.1.3, port:2181, use_ssl:False Connecting to 172.16.1.3(172.16.1.3):2181, use_ssl: False Connecting to 172.16.1.3(172.16.1.3):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Executing query SELECT COUNT() FROM remote('node{1,2}', 'default', 'sometable_select') on distributed Executing query SELECT COUNT() FROM remote('node{1,2}', 'default', 'sometable_select') on distributed run container_id:roottests3latencylog-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'grep -a "Failed to make request to.*resolver:8080.*Timeout: connect timed out" /var/log/clickhouse-server/clickhouse-server.log | wc -l'] run container_id:roottests3latencylog-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'grep -a "Failed to make request to.*resolver:8080.*Timeout: connect timed out" /var/log/clickhouse-server/clickhouse-server.log | wc -l'] Command:[docker exec roottests3latencylog-gw4-node-1 bash -c grep -a "Failed to make request to.*resolver:8080.*Timeout: connect timed out" /var/log/clickhouse-server/clickhouse-server.log | wc -l] Command:[docker exec roottests3latencylog-gw4-node-1 bash -c grep -a "Failed to make request to.*resolver:8080.*Timeout: connect timed out" /var/log/clickhouse-server/clickhouse-server.log | wc -l] Stdout:8 Stdout:8 run container_id:roottests3latencylog-gw4-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://resolver:8080/total'] run container_id:roottests3latencylog-gw4-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://resolver:8080/total'] Command:[docker exec roottests3latencylog-gw4-resolver-1 curl -s http://resolver:8080/total] Command:[docker exec roottests3latencylog-gw4-resolver-1 curl -s http://resolver:8080/total] Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') Trying to create Minio instance by command docker compose --project-name roottestremovestalemovingparts-gw9 --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Trying to create Minio instance by command docker compose --project-name roottestremovestalemovingparts-gw9 --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Command:[docker compose --project-name roottestremovestalemovingparts-gw9 --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Command:[docker compose --project-name roottestremovestalemovingparts-gw9 --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Executing query create workload A1 in X settings priority = -1; on node Executing query create workload A1 in X settings priority = -1; on node Stdout:14 Stdout:14 Latency log after - ([3, 16, 16, 16, 16, 16, 16, 24, 24, 24], [8, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12], [4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4], [7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7]) Latency log after - ([3, 16, 16, 16, 16, 16, 16, 24, 24, 24], [8, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12], [4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4], [7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7]) Connect times after - [(100, 3), (1000, 16), (10000, 16), (100000, 16), (200000, 16), (300000, 16), (500000, 16), (1000000, 24), (1500000, 24), (4294967295, 24)] Connect times after - [(100, 3), (1000, 16), (10000, 16), (100000, 16), (200000, 16), (300000, 16), (500000, 16), (1000000, 24), (1500000, 24), (4294967295, 24)] Connection timed out requests count after - 8 Connection timed out requests count after - 8 Resolver requests count after - 13 Resolver requests count after - 13 Below second connect time cnt - 15, other connect time cnt - 23 Below second connect time cnt - 15, other connect time cnt - 23 Executing query DROP TABLE s3_latency_log_test on node Executing query DROP TABLE s3_latency_log_test on node Executing query SELECT hostName() as host, name, value FROM shard_settings WHERE name = 'max_memory_usage' OR name = 'readonly' ORDER BY host, name, value on distributed Executing query SELECT hostName() as host, name, value FROM shard_settings WHERE name = 'max_memory_usage' OR name = 'readonly' ORDER BY host, name, value on distributed Executing query create workload B1 in X settings priority = 1; on node Executing query create workload B1 in X settings priority = 1; on node Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/.env --project-name roottests3latencylog-gw4 --file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/.env --project-name roottests3latencylog-gw4 --file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml stop --timeout 20] [gw4] PASSED test_s3_latency_log/test.py::test_latency_log Executing query create workload C1 in Y settings priority = -1; on node Executing query create workload C1 in Y settings priority = -1; on node Executing query SELECT hostName() as host, name, value FROM shard_settings WHERE name = 'max_memory_usage' OR name = 'readonly' ORDER BY host, name, value on distributed Executing query SELECT hostName() as host, name, value FROM shard_settings WHERE name = 'max_memory_usage' OR name = 'readonly' ORDER BY host, name, value on distributed Executing query create workload D1 in Y settings priority = 1; on node Executing query create workload D1 in Y settings priority = 1; on node Executing query SELECT hostName() as host, name, value FROM shard_settings WHERE name = 'max_memory_usage' OR name = 'readonly' ORDER BY host, name, value on distributed Executing query SELECT hostName() as host, name, value FROM shard_settings WHERE name = 'max_memory_usage' OR name = 'readonly' ORDER BY host, name, value on distributed Executing query create workload A2 in X settings priority = -1; on node Executing query create workload A2 in X settings priority = -1; on node Executing query SELECT hostName() as host, name, value FROM shard_settings WHERE name = 'max_memory_usage' OR name = 'readonly' ORDER BY host, name, value on distributed Executing query SELECT hostName() as host, name, value FROM shard_settings WHERE name = 'max_memory_usage' OR name = 'readonly' ORDER BY host, name, value on distributed Executing query create workload B2 in X settings priority = 1; on node Executing query create workload B2 in X settings priority = 1; on node Executing query SELECT hostName() as host, name, value FROM shard_settings WHERE name = 'max_memory_usage' OR name = 'readonly' ORDER BY host, name, value on distributed Executing query SELECT hostName() as host, name, value FROM shard_settings WHERE name = 'max_memory_usage' OR name = 'readonly' ORDER BY host, name, value on distributed Executing query create workload C2 in Y settings priority = -1; on node Executing query create workload C2 in Y settings priority = -1; on node Executing query SELECT hostName() as host, name, value FROM shard_settings WHERE name = 'max_memory_usage' OR name = 'readonly' ORDER BY host, name, value on distributed Executing query SELECT hostName() as host, name, value FROM shard_settings WHERE name = 'max_memory_usage' OR name = 'readonly' ORDER BY host, name, value on distributed Stderr:time="2025-04-02T02:55:31Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:55:31Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Volume "roottestremovestalemovingparts-gw9_data1-1" Creating Stderr: Volume "roottestremovestalemovingparts-gw9_data1-1" Creating Stderr: Volume "roottestremovestalemovingparts-gw9_data1-1" Created Stderr: Volume "roottestremovestalemovingparts-gw9_data1-1" Created Stderr:time="2025-04-02T02:55:31Z" level=warning msg="Found orphan containers ([roottestremovestalemovingparts-gw9-zoo2-1 roottestremovestalemovingparts-gw9-zoo1-1 roottestremovestalemovingparts-gw9-zoo3-1]) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up." Stderr:time="2025-04-02T02:55:31Z" level=warning msg="Found orphan containers ([roottestremovestalemovingparts-gw9-zoo2-1 roottestremovestalemovingparts-gw9-zoo1-1 roottestremovestalemovingparts-gw9-zoo3-1]) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up." Stderr: Container roottestremovestalemovingparts-gw9-proxy2-1 Creating Stderr: Container roottestremovestalemovingparts-gw9-proxy2-1 Creating Stderr: Container roottestremovestalemovingparts-gw9-proxy1-1 Creating Stderr: Container roottestremovestalemovingparts-gw9-proxy1-1 Creating Stderr: Container roottestremovestalemovingparts-gw9-proxy2-1 Created Stderr: Container roottestremovestalemovingparts-gw9-proxy2-1 Created Stderr: Container roottestremovestalemovingparts-gw9-proxy1-1 Created Stderr: Container roottestremovestalemovingparts-gw9-proxy1-1 Created Stderr: Container roottestremovestalemovingparts-gw9-minio1-1 Creating Stderr: Container roottestremovestalemovingparts-gw9-minio1-1 Creating Stderr: Container roottestremovestalemovingparts-gw9-resolver-1 Creating Stderr: Container roottestremovestalemovingparts-gw9-resolver-1 Creating Stderr: Container roottestremovestalemovingparts-gw9-resolver-1 Created Stderr: Container roottestremovestalemovingparts-gw9-resolver-1 Created Stderr: Container roottestremovestalemovingparts-gw9-minio1-1 Created Stderr: Container roottestremovestalemovingparts-gw9-minio1-1 Created Stderr: Container roottestremovestalemovingparts-gw9-proxy1-1 Starting Stderr: Container roottestremovestalemovingparts-gw9-proxy1-1 Starting Stderr: Container roottestremovestalemovingparts-gw9-proxy2-1 Starting Stderr: Container roottestremovestalemovingparts-gw9-proxy2-1 Starting Stderr: Container roottestremovestalemovingparts-gw9-proxy2-1 Started Stderr: Container roottestremovestalemovingparts-gw9-proxy2-1 Started Stderr: Container roottestremovestalemovingparts-gw9-proxy1-1 Started Stderr: Container roottestremovestalemovingparts-gw9-proxy1-1 Started Stderr: Container roottestremovestalemovingparts-gw9-minio1-1 Starting Stderr: Container roottestremovestalemovingparts-gw9-minio1-1 Starting Stderr: Container roottestremovestalemovingparts-gw9-resolver-1 Starting Stderr: Container roottestremovestalemovingparts-gw9-resolver-1 Starting Stderr: Container roottestremovestalemovingparts-gw9-resolver-1 Started Stderr: Container roottestremovestalemovingparts-gw9-resolver-1 Started Stderr: Container roottestremovestalemovingparts-gw9-minio1-1 Started Stderr: Container roottestremovestalemovingparts-gw9-minio1-1 Started Stderr:time="2025-04-02T02:55:32Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:55:32Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:55:32Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:55:32Z" level=debug msg="otel error" error="" Trying to connect to Minio... Trying to connect to Minio... get_instance_ip instance_name=minio1 get_instance_ip instance_name=minio1 http://localhost:None "GET /v1.46/containers/roottestremovestalemovingparts-gw9-minio1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestremovestalemovingparts-gw9-minio1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=proxy1 get_instance_ip instance_name=proxy1 http://localhost:None "GET /v1.46/containers/roottestremovestalemovingparts-gw9-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestremovestalemovingparts-gw9-proxy1-1/json HTTP/1.1" 200 None Starting new HTTP connection (1): 172.16.1.8:9001 Starting new HTTP connection (1): 172.16.1.8:9001 Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (2): 172.16.1.8:9001 Starting new HTTP connection (2): 172.16.1.8:9001 Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (3): 172.16.1.8:9001 Starting new HTTP connection (3): 172.16.1.8:9001 Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (4): 172.16.1.8:9001 Starting new HTTP connection (4): 172.16.1.8:9001 Can't connect to Minio: HTTPConnectionPool(host='172.16.1.8', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Can't connect to Minio: HTTPConnectionPool(host='172.16.1.8', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Executing query create workload D2 in Y settings priority = 1; on node Executing query create workload D2 in Y settings priority = 1; on node Executing query SELECT hostName() as host, name, value FROM shard_settings WHERE name = 'max_memory_usage' OR name = 'readonly' ORDER BY host, name, value on distributed Executing query SELECT hostName() as host, name, value FROM shard_settings WHERE name = 'max_memory_usage' OR name = 'readonly' ORDER BY host, name, value on distributed Executing query drop workload A1; on node Executing query drop workload A1; on node Executing query select count() from test_database.postgresql_replica_0 on instance Executing query select count() from test_database.postgresql_replica_0 on instance Executing query drop workload A2; on node Executing query drop workload A2; on node Command:[docker compose --env-file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/.env --project-name roottestsettingsconstraintsdistributed-gw2 --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/distributed/docker-compose.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/.env --project-name roottestsettingsconstraintsdistributed-gw2 --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/distributed/docker-compose.yml stop --timeout 20] [gw2] PASSED test_settings_constraints_distributed/test.py::test_select_clamps_settings Executing query drop workload B1; on node Executing query drop workload B1; on node Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Executing query drop workload B2; on node Executing query drop workload B2; on node Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance Starting new HTTP connection (5): 172.16.1.8:9001 Starting new HTTP connection (5): 172.16.1.8:9001 http://172.16.1.8:9001 "GET / HTTP/1.1" 200 0 http://172.16.1.8:9001 "GET / HTTP/1.1" 200 0 Connected to Minio. Connected to Minio. http://172.16.1.8:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.1.8:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.1.8:9001 "PUT /root HTTP/1.1" 200 0 http://172.16.1.8:9001 "PUT /root HTTP/1.1" 200 0 S3 bucket 'root' created S3 bucket 'root' created http://172.16.1.8:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.1.8:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.1.8:9001 "PUT /root2 HTTP/1.1" 200 0 http://172.16.1.8:9001 "PUT /root2 HTTP/1.1" 200 0 S3 bucket 'root2' created S3 bucket 'root2' created ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/.env --project-name roottestremovestalemovingparts-gw9 --file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/ch1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/.env --project-name roottestremovestalemovingparts-gw9 --file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/ch1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/.env --project-name roottestremovestalemovingparts-gw9 --file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/ch1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/.env --project-name roottestremovestalemovingparts-gw9 --file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/ch1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate] Executing query drop workload C1; on node Executing query drop workload C1; on node Executing query select * from `postgres_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_0` order by key; on instance Executing query drop workload C2; on node Executing query drop workload C2; on node Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query drop workload D1; on node Executing query drop workload D1; on node Stderr: Container roottestremovestalemovingparts-gw9-zoo3-1 Running Stderr: Container roottestremovestalemovingparts-gw9-zoo3-1 Running Stderr: Container roottestremovestalemovingparts-gw9-proxy2-1 Running Stderr: Container roottestremovestalemovingparts-gw9-proxy2-1 Running Stderr: Container roottestremovestalemovingparts-gw9-proxy1-1 Running Stderr: Container roottestremovestalemovingparts-gw9-proxy1-1 Running Stderr: Container roottestremovestalemovingparts-gw9-zoo1-1 Running Stderr: Container roottestremovestalemovingparts-gw9-zoo1-1 Running Stderr: Container roottestremovestalemovingparts-gw9-zoo2-1 Running Stderr: Container roottestremovestalemovingparts-gw9-zoo2-1 Running Stderr: Container roottestremovestalemovingparts-gw9-minio1-1 Running Stderr: Container roottestremovestalemovingparts-gw9-minio1-1 Running Stderr: Container roottestremovestalemovingparts-gw9-resolver-1 Running Stderr: Container roottestremovestalemovingparts-gw9-resolver-1 Running Stderr: Container roottestremovestalemovingparts-gw9-ch1-1 Creating Stderr: Container roottestremovestalemovingparts-gw9-ch1-1 Creating Stderr: Container roottestremovestalemovingparts-gw9-ch1-1 Created Stderr: Container roottestremovestalemovingparts-gw9-ch1-1 Created Stderr: Container roottestremovestalemovingparts-gw9-ch1-1 Starting Stderr: Container roottestremovestalemovingparts-gw9-ch1-1 Starting Stderr: Container roottestremovestalemovingparts-gw9-ch1-1 Started Stderr: Container roottestremovestalemovingparts-gw9-ch1-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=ch1 get_instance_ip instance_name=ch1 http://localhost:None "GET /v1.46/containers/roottestremovestalemovingparts-gw9-ch1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestremovestalemovingparts-gw9-ch1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=ch1 get_instance_ip instance_name=ch1 http://localhost:None "GET /v1.46/containers/roottestremovestalemovingparts-gw9-ch1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestremovestalemovingparts-gw9-ch1-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in ch1, ip: 172.16.1.9... Waiting for ClickHouse start in ch1, ip: 172.16.1.9... http://localhost:None "GET /v1.46/containers/roottestremovestalemovingparts-gw9-ch1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestremovestalemovingparts-gw9-ch1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f6f137fec9c3f9207fd284631c279710c80bed35fa9de03b068446661738168/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f6f137fec9c3f9207fd284631c279710c80bed35fa9de03b068446661738168/json HTTP/1.1" 200 None Executing query drop workload D2; on node Executing query drop workload D2; on node http://localhost:None "GET /v1.46/containers/9f6f137fec9c3f9207fd284631c279710c80bed35fa9de03b068446661738168/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f6f137fec9c3f9207fd284631c279710c80bed35fa9de03b068446661738168/json HTTP/1.1" 200 None run container_id:roottestreplicatedmergetreecompatibility-gw5-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "echo 'restart_with_latest_version: From version' && /usr/share/clickhouse_original server --version && echo 'To version' /usr/share/clickhouse_fresh server --version"] run container_id:roottestreplicatedmergetreecompatibility-gw5-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "echo 'restart_with_latest_version: From version' && /usr/share/clickhouse_original server --version && echo 'To version' /usr/share/clickhouse_fresh server --version"] Command:[docker exec roottestreplicatedmergetreecompatibility-gw5-node2-1 bash -c echo 'restart_with_latest_version: From version' && /usr/share/clickhouse_original server --version && echo 'To version' /usr/share/clickhouse_fresh server --version] Command:[docker exec roottestreplicatedmergetreecompatibility-gw5-node2-1 bash -c echo 'restart_with_latest_version: From version' && /usr/share/clickhouse_original server --version && echo 'To version' /usr/share/clickhouse_fresh server --version] http://localhost:None "GET /v1.46/containers/9f6f137fec9c3f9207fd284631c279710c80bed35fa9de03b068446661738168/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f6f137fec9c3f9207fd284631c279710c80bed35fa9de03b068446661738168/json HTTP/1.1" 200 None Executing query create workload Z in all; on node Executing query create workload Z in all; on node http://localhost:None "GET /v1.46/containers/9f6f137fec9c3f9207fd284631c279710c80bed35fa9de03b068446661738168/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f6f137fec9c3f9207fd284631c279710c80bed35fa9de03b068446661738168/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f6f137fec9c3f9207fd284631c279710c80bed35fa9de03b068446661738168/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f6f137fec9c3f9207fd284631c279710c80bed35fa9de03b068446661738168/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f6f137fec9c3f9207fd284631c279710c80bed35fa9de03b068446661738168/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f6f137fec9c3f9207fd284631c279710c80bed35fa9de03b068446661738168/json HTTP/1.1" 200 None Executing query create workload A1 in Z settings priority = -1; on node Executing query create workload A1 in Z settings priority = -1; on node Stdout:restart_with_latest_version: From version Stdout:restart_with_latest_version: From version Stdout:ClickHouse server version 23.3.22.3 (official build). Stdout:ClickHouse server version 23.3.22.3 (official build). Stdout:To version /usr/share/clickhouse_fresh server --version Stdout:To version /usr/share/clickhouse_fresh server --version run container_id:roottestreplicatedmergetreecompatibility-gw5-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- '] run container_id:roottestreplicatedmergetreecompatibility-gw5-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- '] Command:[docker exec -u 0 roottestreplicatedmergetreecompatibility-gw5-node2-1 bash -c clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ] Command:[docker exec -u 0 roottestreplicatedmergetreecompatibility-gw5-node2-1 bash -c clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ] http://localhost:None "GET /v1.46/containers/9f6f137fec9c3f9207fd284631c279710c80bed35fa9de03b068446661738168/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f6f137fec9c3f9207fd284631c279710c80bed35fa9de03b068446661738168/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f6f137fec9c3f9207fd284631c279710c80bed35fa9de03b068446661738168/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f6f137fec9c3f9207fd284631c279710c80bed35fa9de03b068446661738168/json HTTP/1.1" 200 None run container_id:roottestreplicatedmergetreecompatibility-gw5-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicatedmergetreecompatibility-gw5-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicatedmergetreecompatibility-gw5-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicatedmergetreecompatibility-gw5-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query create workload A2 in Z settings priority = -1; on node Executing query create workload A2 in Z settings priority = -1; on node Stdout:361 Stdout:361 Executing query select 20 on node2 Executing query select 20 on node2 http://localhost:None "GET /v1.46/containers/9f6f137fec9c3f9207fd284631c279710c80bed35fa9de03b068446661738168/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f6f137fec9c3f9207fd284631c279710c80bed35fa9de03b068446661738168/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f6f137fec9c3f9207fd284631c279710c80bed35fa9de03b068446661738168/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f6f137fec9c3f9207fd284631c279710c80bed35fa9de03b068446661738168/json HTTP/1.1" 200 None Executing query create workload A3 in Z settings priority = -1; on node Executing query create workload A3 in Z settings priority = -1; on node http://localhost:None "GET /v1.46/containers/9f6f137fec9c3f9207fd284631c279710c80bed35fa9de03b068446661738168/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f6f137fec9c3f9207fd284631c279710c80bed35fa9de03b068446661738168/json HTTP/1.1" 200 None Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance http://localhost:None "GET /v1.46/containers/9f6f137fec9c3f9207fd284631c279710c80bed35fa9de03b068446661738168/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f6f137fec9c3f9207fd284631c279710c80bed35fa9de03b068446661738168/json HTTP/1.1" 200 None Executing query create workload B1 in Z settings priority = 1; on node Executing query create workload B1 in Z settings priority = 1; on node http://localhost:None "GET /v1.46/containers/9f6f137fec9c3f9207fd284631c279710c80bed35fa9de03b068446661738168/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f6f137fec9c3f9207fd284631c279710c80bed35fa9de03b068446661738168/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f6f137fec9c3f9207fd284631c279710c80bed35fa9de03b068446661738168/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f6f137fec9c3f9207fd284631c279710c80bed35fa9de03b068446661738168/json HTTP/1.1" 200 None Executing query create workload B2 in Z settings priority = 1; on node Executing query create workload B2 in Z settings priority = 1; on node Executing query select 20 on node2 Executing query select 20 on node2 http://localhost:None "GET /v1.46/containers/9f6f137fec9c3f9207fd284631c279710c80bed35fa9de03b068446661738168/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9f6f137fec9c3f9207fd284631c279710c80bed35fa9de03b068446661738168/json HTTP/1.1" 200 None ClickHouse ch1 started ClickHouse ch1 started Executing query CREATE DATABASE IF NOT EXISTS stale_moving_parts on ch1 Executing query CREATE DATABASE IF NOT EXISTS stale_moving_parts on ch1 Executing query create workload B3 in Z settings priority = 1; on node Executing query create workload B3 in Z settings priority = 1; on node Executing query CREATE TABLE test_remove ON CLUSTER cluster ( id UInt32 ) ENGINE ReplicatedMergeTree() ORDER BY id; on ch1 Executing query CREATE TABLE test_remove ON CLUSTER cluster ( id UInt32 ) ENGINE ReplicatedMergeTree() ORDER BY id; on ch1 Executing query create workload C1 in X settings priority = -1; on node Executing query create workload C1 in X settings priority = -1; on node Executing query create workload C2 in X settings priority = -1; on node Executing query create workload C2 in X settings priority = -1; on node Executing query SELECT data_paths FROM system.tables WHERE table = 'test_remove' and database = 'stale_moving_parts' LIMIT 1 on ch1 Executing query SELECT data_paths FROM system.tables WHERE table = 'test_remove' and database = 'stale_moving_parts' LIMIT 1 on ch1 Executing query select 20 on node2 Executing query select 20 on node2 Executing query create workload C3 in X settings priority = -1; on node Executing query create workload C3 in X settings priority = -1; on node Stderr: Container roottestsettingsconstraintsdistributed-gw2-node2-1 Stopping Stderr: Container roottestsettingsconstraintsdistributed-gw2-node2-1 Stopping Stderr: Container roottestsettingsconstraintsdistributed-gw2-node1-1 Stopping Stderr: Container roottestsettingsconstraintsdistributed-gw2-node1-1 Stopping Stderr: Container roottestsettingsconstraintsdistributed-gw2-distributed-1 Stopping Stderr: Container roottestsettingsconstraintsdistributed-gw2-distributed-1 Stopping Stderr: Container roottestsettingsconstraintsdistributed-gw2-distributed-1 Stopped Stderr: Container roottestsettingsconstraintsdistributed-gw2-distributed-1 Stopped Stderr: Container roottestsettingsconstraintsdistributed-gw2-node1-1 Stopped Stderr: Container roottestsettingsconstraintsdistributed-gw2-node1-1 Stopped Stderr: Container roottestsettingsconstraintsdistributed-gw2-node2-1 Stopped Stderr: Container roottestsettingsconstraintsdistributed-gw2-node2-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/distributed/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/distributed/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/distributed/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/distributed/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/.env --project-name roottestsettingsconstraintsdistributed-gw2 --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/distributed/docker-compose.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/.env --project-name roottestsettingsconstraintsdistributed-gw2 --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/distributed/docker-compose.yml down --volumes] Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query SYSTEM ENABLE FAILPOINT stop_moving_part_before_swap_with_active on ch1 Executing query SYSTEM ENABLE FAILPOINT stop_moving_part_before_swap_with_active on ch1 Executing query CREATE TABLE test.table ( a UInt32, b String DEFAULT If(a = 0, 'true', 'false'), c String DEFAULT Cast(a, 'String') ) ENGINE = ReplicatedMergeTree('/clickhouse/tables/test/table', '1') ORDER BY a on node1 Executing query CREATE TABLE test.table ( a UInt32, b String DEFAULT If(a = 0, 'true', 'false'), c String DEFAULT Cast(a, 'String') ) ENGINE = ReplicatedMergeTree('/clickhouse/tables/test/table', '1') ORDER BY a on node1 Executing query create workload D1 in X settings priority = 1; on node Executing query create workload D1 in X settings priority = 1; on node Executing query INSERT INTO test_remove SELECT number FROM numbers(100); on ch1 Executing query INSERT INTO test_remove SELECT number FROM numbers(100); on ch1 Executing query create workload D2 in X settings priority = 1; on node Executing query create workload D2 in X settings priority = 1; on node Executing query EXISTS TABLE test.table on node1 Executing query EXISTS TABLE test.table on node1 Executing query create workload D3 in X settings priority = 1; on node Executing query create workload D3 in X settings priority = 1; on node Executing query ALTER TABLE test_remove MOVE PART 'all_0_0_0' TO DISK 's3' on ch1 Executing query ALTER TABLE test_remove MOVE PART 'all_0_0_0' TO DISK 's3' on ch1 Executing query SELECT part_name FROM system.moves on ch1 Executing query SELECT part_name FROM system.moves on ch1 Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/.env --project-name roottestreplicatedmergetreecompatibility-gw5 --file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/node2/docker-compose.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/.env --project-name roottestreplicatedmergetreecompatibility-gw5 --file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/node2/docker-compose.yml stop --timeout 20] [gw5] PASSED test_replicated_merge_tree_compatibility/test.py::test_replicated_merge_tree_defaults_compatibility Stderr: Container roottestsettingsconstraintsdistributed-gw2-distributed-1 Stopping Stderr: Container roottestsettingsconstraintsdistributed-gw2-distributed-1 Stopping Stderr: Container roottestsettingsconstraintsdistributed-gw2-node2-1 Stopping Stderr: Container roottestsettingsconstraintsdistributed-gw2-node2-1 Stopping Stderr: Container roottestsettingsconstraintsdistributed-gw2-node1-1 Stopping Stderr: Container roottestsettingsconstraintsdistributed-gw2-node1-1 Stopping Stderr: Container roottestsettingsconstraintsdistributed-gw2-distributed-1 Stopped Stderr: Container roottestsettingsconstraintsdistributed-gw2-distributed-1 Stopped Stderr: Container roottestsettingsconstraintsdistributed-gw2-distributed-1 Removing Stderr: Container roottestsettingsconstraintsdistributed-gw2-distributed-1 Removing Stderr: Container roottestsettingsconstraintsdistributed-gw2-node1-1 Stopped Stderr: Container roottestsettingsconstraintsdistributed-gw2-node1-1 Stopped Stderr: Container roottestsettingsconstraintsdistributed-gw2-node1-1 Removing Stderr: Container roottestsettingsconstraintsdistributed-gw2-node1-1 Removing Stderr: Container roottestsettingsconstraintsdistributed-gw2-node2-1 Stopped Stderr: Container roottestsettingsconstraintsdistributed-gw2-node2-1 Stopped Stderr: Container roottestsettingsconstraintsdistributed-gw2-node2-1 Removing Stderr: Container roottestsettingsconstraintsdistributed-gw2-node2-1 Removing Stderr: Container roottestsettingsconstraintsdistributed-gw2-node1-1 Removed Stderr: Container roottestsettingsconstraintsdistributed-gw2-node1-1 Removed Stderr: Container roottestsettingsconstraintsdistributed-gw2-distributed-1 Removed Stderr: Container roottestsettingsconstraintsdistributed-gw2-distributed-1 Removed Stderr: Container roottestsettingsconstraintsdistributed-gw2-node2-1 Removed Stderr: Container roottestsettingsconstraintsdistributed-gw2-node2-1 Removed Stderr: Network roottestsettingsconstraintsdistributed-gw2_default Removing Stderr: Network roottestsettingsconstraintsdistributed-gw2_default Removing Stderr: Network roottestsettingsconstraintsdistributed-gw2_default Removed Stderr: Network roottestsettingsconstraintsdistributed-gw2_default Removed Cleanup called Cleanup called Docker networks for project roottestsettingsconstraintsdistributed-gw2 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestsettingsconstraintsdistributed-gw2 are NETWORK ID NAME DRIVER SCOPE Executing query drop workload A1; on node Executing query drop workload A1; on node Docker containers for project roottestsettingsconstraintsdistributed-gw2 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestsettingsconstraintsdistributed-gw2 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestsettingsconstraintsdistributed-gw2 are DRIVER VOLUME NAME Docker volumes for project roottestsettingsconstraintsdistributed-gw2 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestsettingsconstraintsdistributed-gw2-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestsettingsconstraintsdistributed-gw2-.*-1$' --format '{{.ID}}:{{.Names}}'] run container_id:roottestremovestalemovingparts-gw9-ch1-1 detach:False nothrow:False cmd: ['bash', '-c', 'ls /var/lib/clickhouse/disks/s3/store/cbd/cbdd4f1a-cec1-42c2-99da-3c552d3120ea/moving'] run container_id:roottestremovestalemovingparts-gw9-ch1-1 detach:False nothrow:False cmd: ['bash', '-c', 'ls /var/lib/clickhouse/disks/s3/store/cbd/cbdd4f1a-cec1-42c2-99da-3c552d3120ea/moving'] Command:[docker exec roottestremovestalemovingparts-gw9-ch1-1 bash -c ls /var/lib/clickhouse/disks/s3/store/cbd/cbdd4f1a-cec1-42c2-99da-3c552d3120ea/moving] Command:[docker exec roottestremovestalemovingparts-gw9-ch1-1 bash -c ls /var/lib/clickhouse/disks/s3/store/cbd/cbdd4f1a-cec1-42c2-99da-3c552d3120ea/moving] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestsettingsconstraintsdistributed-gw2 No running containers for project: roottestsettingsconstraintsdistributed-gw2 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:all_0_0_0 Stdout:all_0_0_0 Stopping zookeeper node: zoo1 Stopping zookeeper node: zoo1 Command:[docker compose --project-name roottestremovestalemovingparts-gw9 --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop zoo1] Command:[docker compose --project-name roottestremovestalemovingparts-gw9 --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop zoo1] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:11 Stdout:11 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 11 Volumes pruned: 11 Executing query drop workload B1; on node Executing query drop workload B1; on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query drop workload C1; on node Executing query drop workload C1; on node Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query drop workload D1; on node Executing query drop workload D1; on node Executing query create resource io_test (write disk non_existent_disk, read disk non_existent_disk); on node Executing query create resource io_test (write disk non_existent_disk, read disk non_existent_disk); on node Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance [gw1] PASSED test_postgresql_replica_database_engine_1/test.py::test_single_transaction Executing query drop resource io_test; on node Executing query drop resource io_test; on node Executing query drop workload A2; on node Executing query drop workload A2; on node Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query drop workload B2; on node Executing query drop workload B2; on node Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query drop workload C2; on node Executing query drop workload C2; on node Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: proxy1 Pulling Stderr: proxy1 Pulling Stderr: node Pulling Stderr: node Pulling Stderr: minio1 Pulling Stderr: minio1 Pulling Stderr: resolver Pulling Stderr: resolver Pulling Stderr: minio1 Pulled Stderr: minio1 Pulled Stderr: resolver Pulled Stderr: resolver Pulled Stderr: proxy1 Pulled Stderr: proxy1 Pulled Stderr: node Pulled Stderr: node Pulled Trying to create Minio instance by command docker compose --project-name roottests3imdssimple-gw6 --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Trying to create Minio instance by command docker compose --project-name roottests3imdssimple-gw6 --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Command:[docker compose --project-name roottests3imdssimple-gw6 --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Command:[docker compose --project-name roottests3imdssimple-gw6 --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Executing query drop workload D2; on node Executing query drop workload D2; on node test_postgresql_replica_database_engine_1/test.py::test_table_schema_changes Executing query INSERT INTO postgres_database.postgresql_replica_0 SELECT number, 0, 0, 0 from numbers(25) on instance Executing query INSERT INTO postgres_database.postgresql_replica_0 SELECT number, 0, 0, 0 from numbers(25) on instance Executing query drop workload A3; on node Executing query drop workload A3; on node Executing query drop workload B3; on node Executing query drop workload B3; on node Executing query INSERT INTO postgres_database.postgresql_replica_1 SELECT number, 1, 1, 1 from numbers(25) on instance Executing query INSERT INTO postgres_database.postgresql_replica_1 SELECT number, 1, 1, 1 from numbers(25) on instance Executing query drop workload C3; on node Executing query drop workload C3; on node Executing query INSERT INTO postgres_database.postgresql_replica_2 SELECT number, 2, 2, 2 from numbers(25) on instance Executing query INSERT INTO postgres_database.postgresql_replica_2 SELECT number, 2, 2, 2 from numbers(25) on instance Executing query drop workload D3; on node Executing query drop workload D3; on node Stderr:time="2025-04-02T02:55:39Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:55:39Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottests3imdssimple-gw6_default Creating Stderr: Network roottests3imdssimple-gw6_default Creating Stderr: Network roottests3imdssimple-gw6_default Created Stderr: Network roottests3imdssimple-gw6_default Created Stderr: Volume "roottests3imdssimple-gw6_data1-1" Creating Stderr: Volume "roottests3imdssimple-gw6_data1-1" Creating Stderr: Volume "roottests3imdssimple-gw6_data1-1" Created Stderr: Volume "roottests3imdssimple-gw6_data1-1" Created Stderr: Container roottests3imdssimple-gw6-proxy2-1 Creating Stderr: Container roottests3imdssimple-gw6-proxy2-1 Creating Stderr: Container roottests3imdssimple-gw6-proxy1-1 Creating Stderr: Container roottests3imdssimple-gw6-proxy1-1 Creating Stderr: Container roottests3imdssimple-gw6-proxy2-1 Created Stderr: Container roottests3imdssimple-gw6-proxy2-1 Created Stderr: Container roottests3imdssimple-gw6-proxy1-1 Created Stderr: Container roottests3imdssimple-gw6-proxy1-1 Created Stderr: Container roottests3imdssimple-gw6-resolver-1 Creating Stderr: Container roottests3imdssimple-gw6-resolver-1 Creating Stderr: Container roottests3imdssimple-gw6-minio1-1 Creating Stderr: Container roottests3imdssimple-gw6-minio1-1 Creating Stderr: Container roottests3imdssimple-gw6-resolver-1 Created Stderr: Container roottests3imdssimple-gw6-resolver-1 Created Stderr: Container roottests3imdssimple-gw6-minio1-1 Created Stderr: Container roottests3imdssimple-gw6-minio1-1 Created Stderr: Container roottests3imdssimple-gw6-proxy2-1 Starting Stderr: Container roottests3imdssimple-gw6-proxy2-1 Starting Stderr: Container roottests3imdssimple-gw6-proxy1-1 Starting Stderr: Container roottests3imdssimple-gw6-proxy1-1 Starting Stderr: Container roottests3imdssimple-gw6-proxy2-1 Started Stderr: Container roottests3imdssimple-gw6-proxy2-1 Started Stderr: Container roottests3imdssimple-gw6-proxy1-1 Started Stderr: Container roottests3imdssimple-gw6-proxy1-1 Started Stderr: Container roottests3imdssimple-gw6-minio1-1 Starting Stderr: Container roottests3imdssimple-gw6-minio1-1 Starting Stderr: Container roottests3imdssimple-gw6-resolver-1 Starting Stderr: Container roottests3imdssimple-gw6-resolver-1 Starting Stderr: Container roottests3imdssimple-gw6-minio1-1 Started Stderr: Container roottests3imdssimple-gw6-minio1-1 Started Stderr: Container roottests3imdssimple-gw6-resolver-1 Started Stderr: Container roottests3imdssimple-gw6-resolver-1 Started Stderr:time="2025-04-02T02:55:40Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:55:40Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:55:40Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:55:40Z" level=debug msg="otel error" error="" Trying to connect to Minio... Trying to connect to Minio... get_instance_ip instance_name=minio1 get_instance_ip instance_name=minio1 http://localhost:None "GET /v1.46/containers/roottests3imdssimple-gw6-minio1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3imdssimple-gw6-minio1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=proxy1 get_instance_ip instance_name=proxy1 http://localhost:None "GET /v1.46/containers/roottests3imdssimple-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3imdssimple-gw6-proxy1-1/json HTTP/1.1" 200 None Executing query INSERT INTO postgres_database.postgresql_replica_3 SELECT number, 3, 3, 3 from numbers(25) on instance Executing query INSERT INTO postgres_database.postgresql_replica_3 SELECT number, 3, 3, 3 from numbers(25) on instance Starting new HTTP connection (1): 172.16.2.4:9001 Starting new HTTP connection (1): 172.16.2.4:9001 Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (2): 172.16.2.4:9001 Starting new HTTP connection (2): 172.16.2.4:9001 Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (3): 172.16.2.4:9001 Starting new HTTP connection (3): 172.16.2.4:9001 Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (4): 172.16.2.4:9001 Starting new HTTP connection (4): 172.16.2.4:9001 Can't connect to Minio: HTTPConnectionPool(host='172.16.2.4', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Can't connect to Minio: HTTPConnectionPool(host='172.16.2.4', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Executing query drop workload X; on node Executing query drop workload X; on node Executing query INSERT INTO postgres_database.postgresql_replica_4 SELECT number, 4, 4, 4 from numbers(25) on instance Executing query INSERT INTO postgres_database.postgresql_replica_4 SELECT number, 4, 4, 4 from numbers(25) on instance Executing query drop workload Y; on node Executing query drop workload Y; on node Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query drop workload Z; on node Executing query drop workload Z; on node Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query drop workload all; on node Executing query drop workload all; on node Executing query SHOW DATABASES on instance Executing query SHOW DATABASES on instance Executing query create workload all; on node Executing query create workload all; on node Executing query INSERT INTO postgres_database.postgresql_replica_0 SELECT 25 + number, 0, 0, 0 from numbers(25) on instance Executing query INSERT INTO postgres_database.postgresql_replica_0 SELECT 25 + number, 0, 0, 0 from numbers(25) on instance Starting new HTTP connection (5): 172.16.2.4:9001 Starting new HTTP connection (5): 172.16.2.4:9001 http://172.16.2.4:9001 "GET / HTTP/1.1" 200 0 http://172.16.2.4:9001 "GET / HTTP/1.1" 200 0 Connected to Minio. Connected to Minio. http://172.16.2.4:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.2.4:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.2.4:9001 "PUT /root HTTP/1.1" 200 0 http://172.16.2.4:9001 "PUT /root HTTP/1.1" 200 0 S3 bucket 'root' created S3 bucket 'root' created http://172.16.2.4:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.2.4:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.2.4:9001 "PUT /root2 HTTP/1.1" 200 0 http://172.16.2.4:9001 "PUT /root2 HTTP/1.1" 200 0 S3 bucket 'root2' created S3 bucket 'root2' created ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/.env --project-name roottests3imdssimple-gw6 --file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/.env --project-name roottests3imdssimple-gw6 --file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/.env --project-name roottests3imdssimple-gw6 --file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/.env --project-name roottests3imdssimple-gw6 --file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate] Executing query create workload X in all settings priority = 0; on node Executing query create workload X in all settings priority = 0; on node Executing query INSERT INTO postgres_database.postgresql_replica_1 SELECT 25 + number, 1, 1, 1 from numbers(25) on instance Executing query INSERT INTO postgres_database.postgresql_replica_1 SELECT 25 + number, 1, 1, 1 from numbers(25) on instance Stderr: Container roottests3imdssimple-gw6-proxy1-1 Running Stderr: Container roottests3imdssimple-gw6-proxy1-1 Running Stderr: Container roottests3imdssimple-gw6-proxy2-1 Running Stderr: Container roottests3imdssimple-gw6-proxy2-1 Running Stderr: Container roottests3imdssimple-gw6-minio1-1 Running Stderr: Container roottests3imdssimple-gw6-minio1-1 Running Stderr: Container roottests3imdssimple-gw6-resolver-1 Running Stderr: Container roottests3imdssimple-gw6-resolver-1 Running Stderr: Container roottests3imdssimple-gw6-node-1 Creating Stderr: Container roottests3imdssimple-gw6-node-1 Creating Stderr: Container roottests3imdssimple-gw6-node-1 Created Stderr: Container roottests3imdssimple-gw6-node-1 Created Stderr: Container roottests3imdssimple-gw6-node-1 Starting Stderr: Container roottests3imdssimple-gw6-node-1 Starting Stderr: Container roottests3imdssimple-gw6-node-1 Started Stderr: Container roottests3imdssimple-gw6-node-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottests3imdssimple-gw6-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3imdssimple-gw6-node-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottests3imdssimple-gw6-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3imdssimple-gw6-node-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node, ip: 172.16.2.6... Waiting for ClickHouse start in node, ip: 172.16.2.6... http://localhost:None "GET /v1.46/containers/roottests3imdssimple-gw6-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3imdssimple-gw6-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4d7edb9a055ab5dda4da32d7f039dde3a8288b4a55c671728560e0df1b4c4866/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4d7edb9a055ab5dda4da32d7f039dde3a8288b4a55c671728560e0df1b4c4866/json HTTP/1.1" 200 None Executing query create workload Y in all settings priority = 1; on node Executing query create workload Y in all settings priority = 1; on node http://localhost:None "GET /v1.46/containers/4d7edb9a055ab5dda4da32d7f039dde3a8288b4a55c671728560e0df1b4c4866/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4d7edb9a055ab5dda4da32d7f039dde3a8288b4a55c671728560e0df1b4c4866/json HTTP/1.1" 200 None Executing query INSERT INTO postgres_database.postgresql_replica_2 SELECT 25 + number, 2, 2, 2 from numbers(25) on instance Executing query INSERT INTO postgres_database.postgresql_replica_2 SELECT 25 + number, 2, 2, 2 from numbers(25) on instance http://localhost:None "GET /v1.46/containers/4d7edb9a055ab5dda4da32d7f039dde3a8288b4a55c671728560e0df1b4c4866/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4d7edb9a055ab5dda4da32d7f039dde3a8288b4a55c671728560e0df1b4c4866/json HTTP/1.1" 200 None Executing query create workload A1 in X settings priority = -1; on node Executing query create workload A1 in X settings priority = -1; on node http://localhost:None "GET /v1.46/containers/4d7edb9a055ab5dda4da32d7f039dde3a8288b4a55c671728560e0df1b4c4866/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4d7edb9a055ab5dda4da32d7f039dde3a8288b4a55c671728560e0df1b4c4866/json HTTP/1.1" 200 None Executing query INSERT INTO postgres_database.postgresql_replica_3 SELECT 25 + number, 3, 3, 3 from numbers(25) on instance Executing query INSERT INTO postgres_database.postgresql_replica_3 SELECT 25 + number, 3, 3, 3 from numbers(25) on instance http://localhost:None "GET /v1.46/containers/4d7edb9a055ab5dda4da32d7f039dde3a8288b4a55c671728560e0df1b4c4866/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4d7edb9a055ab5dda4da32d7f039dde3a8288b4a55c671728560e0df1b4c4866/json HTTP/1.1" 200 None Executing query create workload B1 in X settings priority = 1; on node Executing query create workload B1 in X settings priority = 1; on node http://localhost:None "GET /v1.46/containers/4d7edb9a055ab5dda4da32d7f039dde3a8288b4a55c671728560e0df1b4c4866/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4d7edb9a055ab5dda4da32d7f039dde3a8288b4a55c671728560e0df1b4c4866/json HTTP/1.1" 200 None Executing query INSERT INTO postgres_database.postgresql_replica_4 SELECT 25 + number, 4, 4, 4 from numbers(25) on instance Executing query INSERT INTO postgres_database.postgresql_replica_4 SELECT 25 + number, 4, 4, 4 from numbers(25) on instance http://localhost:None "GET /v1.46/containers/4d7edb9a055ab5dda4da32d7f039dde3a8288b4a55c671728560e0df1b4c4866/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4d7edb9a055ab5dda4da32d7f039dde3a8288b4a55c671728560e0df1b4c4866/json HTTP/1.1" 200 None Executing query create workload C1 in Y settings priority = -1; on node Executing query create workload C1 in Y settings priority = -1; on node http://localhost:None "GET /v1.46/containers/4d7edb9a055ab5dda4da32d7f039dde3a8288b4a55c671728560e0df1b4c4866/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4d7edb9a055ab5dda4da32d7f039dde3a8288b4a55c671728560e0df1b4c4866/json HTTP/1.1" 200 None Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance http://localhost:None "GET /v1.46/containers/4d7edb9a055ab5dda4da32d7f039dde3a8288b4a55c671728560e0df1b4c4866/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4d7edb9a055ab5dda4da32d7f039dde3a8288b4a55c671728560e0df1b4c4866/json HTTP/1.1" 200 None Executing query create workload D1 in Y settings priority = 1; on node Executing query create workload D1 in Y settings priority = 1; on node http://localhost:None "GET /v1.46/containers/4d7edb9a055ab5dda4da32d7f039dde3a8288b4a55c671728560e0df1b4c4866/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4d7edb9a055ab5dda4da32d7f039dde3a8288b4a55c671728560e0df1b4c4866/json HTTP/1.1" 200 None Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance http://localhost:None "GET /v1.46/containers/4d7edb9a055ab5dda4da32d7f039dde3a8288b4a55c671728560e0df1b4c4866/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4d7edb9a055ab5dda4da32d7f039dde3a8288b4a55c671728560e0df1b4c4866/json HTTP/1.1" 200 None Executing query create workload A2 in X settings priority = -1; on node Executing query create workload A2 in X settings priority = -1; on node http://localhost:None "GET /v1.46/containers/4d7edb9a055ab5dda4da32d7f039dde3a8288b4a55c671728560e0df1b4c4866/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4d7edb9a055ab5dda4da32d7f039dde3a8288b4a55c671728560e0df1b4c4866/json HTTP/1.1" 200 None Executing query select * from `postgres_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_0` order by key; on instance http://localhost:None "GET /v1.46/containers/4d7edb9a055ab5dda4da32d7f039dde3a8288b4a55c671728560e0df1b4c4866/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4d7edb9a055ab5dda4da32d7f039dde3a8288b4a55c671728560e0df1b4c4866/json HTTP/1.1" 200 None ClickHouse node started ClickHouse node started Starting mock server simple_server.py Starting mock server simple_server.py run container_id:roottests3imdssimple-gw6-resolver-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname simple_server.py) && echo aW1wb3J0IGh0dHAuc2VydmVyCmltcG9ydCBzeXMKCgpjbGFzcyBSZXF1ZXN0SGFuZGxlcihodHRwLnNlcnZlci5CYXNlSFRUUFJlcXVlc3RIYW5kbGVyKToKICAgIGRlZiBnZXRfcmVzcG9uc2Uoc2VsZik6CiAgICAgICAgaWYgc2VsZi5wYXRoID09ICIvIjoKICAgICAgICAgICAgcmV0dXJuICJPSyIsIDIwMAoKICAgICAgICBpZiBzZWxmLnBhdGggPT0gIi9sYXRlc3QvbWV0YS1kYXRhL2lhbS9zZWN1cml0eS1jcmVkZW50aWFscyI6CiAgICAgICAgICAgIHJldHVybiAibXlyb2xlIiwgMjAwCgogICAgICAgIGlmIHNlbGYucGF0aCA9PSAiL2xhdGVzdC9tZXRhLWRhdGEvaWFtL3NlY3VyaXR5LWNyZWRlbnRpYWxzL215cm9sZSI6CiAgICAgICAgICAgIHJldHVybiAoCiAgICAgICAgICAgICAgICAneyAiQ29kZSIgOiAiU3VjY2VzcyIsICJUeXBlIiA6ICJBV1MtSE1BQyIsICJBY2Nlc3NLZXlJZCIgOiAibWluaW8iLCAiU2VjcmV0QWNjZXNzS2V5IiA6ICJtaW5pbzEyMyIgfScsCiAgICAgICAgICAgICAgICAyMDAsCiAgICAgICAgICAgICkKCiAgICAgICAgIyBSZXNvdXJjZSBub3QgZm91bmQuCiAgICAgICAgcmV0dXJuIDQwNAoKICAgIGRlZiBkb19IRUFEKHNlbGYpOgogICAgICAgIHJlc3BvbnNlLCBjb2RlID0gc2VsZi5nZXRfcmVzcG9uc2UoKQogICAgICAgIHNlbGYuc2VuZF9yZXNwb25zZShjb2RlKQogICAgICAgIHNlbGYuc2VuZF9oZWFkZXIoIkNvbnRlbnQtVHlwZSIsICJ0ZXh0L3BsYWluIikKICAgICAgICBzZWxmLnNlbmRfaGVhZGVyKCJDb250ZW50LUxlbmd0aCIsIGxlbihyZXNwb25zZS5lbmNvZGUoKSkpCiAgICAgICAgc2VsZi5lbmRfaGVhZGVycygpCiAgICAgICAgcmV0dXJuIHJlc3BvbnNlLCBjb2RlCgogICAgZGVmIGRvX0dFVChzZWxmKToKICAgICAgICByZXNwb25zZSwgXyA9IHNlbGYuZG9fSEVBRCgpCiAgICAgICAgc2VsZi53ZmlsZS53cml0ZShyZXNwb25zZS5lbmNvZGUoKSkKCgpodHRwZCA9IGh0dHAuc2VydmVyLkhUVFBTZXJ2ZXIoKCIwLjAuMC4wIiwgaW50KHN5cy5hcmd2WzFdKSksIFJlcXVlc3RIYW5kbGVyKQpodHRwZC5zZXJ2ZV9mb3JldmVyKCkK | base64 --decode > simple_server.py'] run container_id:roottests3imdssimple-gw6-resolver-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname simple_server.py) && echo aW1wb3J0IGh0dHAuc2VydmVyCmltcG9ydCBzeXMKCgpjbGFzcyBSZXF1ZXN0SGFuZGxlcihodHRwLnNlcnZlci5CYXNlSFRUUFJlcXVlc3RIYW5kbGVyKToKICAgIGRlZiBnZXRfcmVzcG9uc2Uoc2VsZik6CiAgICAgICAgaWYgc2VsZi5wYXRoID09ICIvIjoKICAgICAgICAgICAgcmV0dXJuICJPSyIsIDIwMAoKICAgICAgICBpZiBzZWxmLnBhdGggPT0gIi9sYXRlc3QvbWV0YS1kYXRhL2lhbS9zZWN1cml0eS1jcmVkZW50aWFscyI6CiAgICAgICAgICAgIHJldHVybiAibXlyb2xlIiwgMjAwCgogICAgICAgIGlmIHNlbGYucGF0aCA9PSAiL2xhdGVzdC9tZXRhLWRhdGEvaWFtL3NlY3VyaXR5LWNyZWRlbnRpYWxzL215cm9sZSI6CiAgICAgICAgICAgIHJldHVybiAoCiAgICAgICAgICAgICAgICAneyAiQ29kZSIgOiAiU3VjY2VzcyIsICJUeXBlIiA6ICJBV1MtSE1BQyIsICJBY2Nlc3NLZXlJZCIgOiAibWluaW8iLCAiU2VjcmV0QWNjZXNzS2V5IiA6ICJtaW5pbzEyMyIgfScsCiAgICAgICAgICAgICAgICAyMDAsCiAgICAgICAgICAgICkKCiAgICAgICAgIyBSZXNvdXJjZSBub3QgZm91bmQuCiAgICAgICAgcmV0dXJuIDQwNAoKICAgIGRlZiBkb19IRUFEKHNlbGYpOgogICAgICAgIHJlc3BvbnNlLCBjb2RlID0gc2VsZi5nZXRfcmVzcG9uc2UoKQogICAgICAgIHNlbGYuc2VuZF9yZXNwb25zZShjb2RlKQogICAgICAgIHNlbGYuc2VuZF9oZWFkZXIoIkNvbnRlbnQtVHlwZSIsICJ0ZXh0L3BsYWluIikKICAgICAgICBzZWxmLnNlbmRfaGVhZGVyKCJDb250ZW50LUxlbmd0aCIsIGxlbihyZXNwb25zZS5lbmNvZGUoKSkpCiAgICAgICAgc2VsZi5lbmRfaGVhZGVycygpCiAgICAgICAgcmV0dXJuIHJlc3BvbnNlLCBjb2RlCgogICAgZGVmIGRvX0dFVChzZWxmKToKICAgICAgICByZXNwb25zZSwgXyA9IHNlbGYuZG9fSEVBRCgpCiAgICAgICAgc2VsZi53ZmlsZS53cml0ZShyZXNwb25zZS5lbmNvZGUoKSkKCgpodHRwZCA9IGh0dHAuc2VydmVyLkhUVFBTZXJ2ZXIoKCIwLjAuMC4wIiwgaW50KHN5cy5hcmd2WzFdKSksIFJlcXVlc3RIYW5kbGVyKQpodHRwZC5zZXJ2ZV9mb3JldmVyKCkK | base64 --decode > simple_server.py'] Command:[docker exec roottests3imdssimple-gw6-resolver-1 bash -c mkdir -p $(dirname simple_server.py) && echo aW1wb3J0IGh0dHAuc2VydmVyCmltcG9ydCBzeXMKCgpjbGFzcyBSZXF1ZXN0SGFuZGxlcihodHRwLnNlcnZlci5CYXNlSFRUUFJlcXVlc3RIYW5kbGVyKToKICAgIGRlZiBnZXRfcmVzcG9uc2Uoc2VsZik6CiAgICAgICAgaWYgc2VsZi5wYXRoID09ICIvIjoKICAgICAgICAgICAgcmV0dXJuICJPSyIsIDIwMAoKICAgICAgICBpZiBzZWxmLnBhdGggPT0gIi9sYXRlc3QvbWV0YS1kYXRhL2lhbS9zZWN1cml0eS1jcmVkZW50aWFscyI6CiAgICAgICAgICAgIHJldHVybiAibXlyb2xlIiwgMjAwCgogICAgICAgIGlmIHNlbGYucGF0aCA9PSAiL2xhdGVzdC9tZXRhLWRhdGEvaWFtL3NlY3VyaXR5LWNyZWRlbnRpYWxzL215cm9sZSI6CiAgICAgICAgICAgIHJldHVybiAoCiAgICAgICAgICAgICAgICAneyAiQ29kZSIgOiAiU3VjY2VzcyIsICJUeXBlIiA6ICJBV1MtSE1BQyIsICJBY2Nlc3NLZXlJZCIgOiAibWluaW8iLCAiU2VjcmV0QWNjZXNzS2V5IiA6ICJtaW5pbzEyMyIgfScsCiAgICAgICAgICAgICAgICAyMDAsCiAgICAgICAgICAgICkKCiAgICAgICAgIyBSZXNvdXJjZSBub3QgZm91bmQuCiAgICAgICAgcmV0dXJuIDQwNAoKICAgIGRlZiBkb19IRUFEKHNlbGYpOgogICAgICAgIHJlc3BvbnNlLCBjb2RlID0gc2VsZi5nZXRfcmVzcG9uc2UoKQogICAgICAgIHNlbGYuc2VuZF9yZXNwb25zZShjb2RlKQogICAgICAgIHNlbGYuc2VuZF9oZWFkZXIoIkNvbnRlbnQtVHlwZSIsICJ0ZXh0L3BsYWluIikKICAgICAgICBzZWxmLnNlbmRfaGVhZGVyKCJDb250ZW50LUxlbmd0aCIsIGxlbihyZXNwb25zZS5lbmNvZGUoKSkpCiAgICAgICAgc2VsZi5lbmRfaGVhZGVycygpCiAgICAgICAgcmV0dXJuIHJlc3BvbnNlLCBjb2RlCgogICAgZGVmIGRvX0dFVChzZWxmKToKICAgICAgICByZXNwb25zZSwgXyA9IHNlbGYuZG9fSEVBRCgpCiAgICAgICAgc2VsZi53ZmlsZS53cml0ZShyZXNwb25zZS5lbmNvZGUoKSkKCgpodHRwZCA9IGh0dHAuc2VydmVyLkhUVFBTZXJ2ZXIoKCIwLjAuMC4wIiwgaW50KHN5cy5hcmd2WzFdKSksIFJlcXVlc3RIYW5kbGVyKQpodHRwZC5zZXJ2ZV9mb3JldmVyKCkK | base64 --decode > simple_server.py] Command:[docker exec roottests3imdssimple-gw6-resolver-1 bash -c mkdir -p $(dirname simple_server.py) && echo aW1wb3J0IGh0dHAuc2VydmVyCmltcG9ydCBzeXMKCgpjbGFzcyBSZXF1ZXN0SGFuZGxlcihodHRwLnNlcnZlci5CYXNlSFRUUFJlcXVlc3RIYW5kbGVyKToKICAgIGRlZiBnZXRfcmVzcG9uc2Uoc2VsZik6CiAgICAgICAgaWYgc2VsZi5wYXRoID09ICIvIjoKICAgICAgICAgICAgcmV0dXJuICJPSyIsIDIwMAoKICAgICAgICBpZiBzZWxmLnBhdGggPT0gIi9sYXRlc3QvbWV0YS1kYXRhL2lhbS9zZWN1cml0eS1jcmVkZW50aWFscyI6CiAgICAgICAgICAgIHJldHVybiAibXlyb2xlIiwgMjAwCgogICAgICAgIGlmIHNlbGYucGF0aCA9PSAiL2xhdGVzdC9tZXRhLWRhdGEvaWFtL3NlY3VyaXR5LWNyZWRlbnRpYWxzL215cm9sZSI6CiAgICAgICAgICAgIHJldHVybiAoCiAgICAgICAgICAgICAgICAneyAiQ29kZSIgOiAiU3VjY2VzcyIsICJUeXBlIiA6ICJBV1MtSE1BQyIsICJBY2Nlc3NLZXlJZCIgOiAibWluaW8iLCAiU2VjcmV0QWNjZXNzS2V5IiA6ICJtaW5pbzEyMyIgfScsCiAgICAgICAgICAgICAgICAyMDAsCiAgICAgICAgICAgICkKCiAgICAgICAgIyBSZXNvdXJjZSBub3QgZm91bmQuCiAgICAgICAgcmV0dXJuIDQwNAoKICAgIGRlZiBkb19IRUFEKHNlbGYpOgogICAgICAgIHJlc3BvbnNlLCBjb2RlID0gc2VsZi5nZXRfcmVzcG9uc2UoKQogICAgICAgIHNlbGYuc2VuZF9yZXNwb25zZShjb2RlKQogICAgICAgIHNlbGYuc2VuZF9oZWFkZXIoIkNvbnRlbnQtVHlwZSIsICJ0ZXh0L3BsYWluIikKICAgICAgICBzZWxmLnNlbmRfaGVhZGVyKCJDb250ZW50LUxlbmd0aCIsIGxlbihyZXNwb25zZS5lbmNvZGUoKSkpCiAgICAgICAgc2VsZi5lbmRfaGVhZGVycygpCiAgICAgICAgcmV0dXJuIHJlc3BvbnNlLCBjb2RlCgogICAgZGVmIGRvX0dFVChzZWxmKToKICAgICAgICByZXNwb25zZSwgXyA9IHNlbGYuZG9fSEVBRCgpCiAgICAgICAgc2VsZi53ZmlsZS53cml0ZShyZXNwb25zZS5lbmNvZGUoKSkKCgpodHRwZCA9IGh0dHAuc2VydmVyLkhUVFBTZXJ2ZXIoKCIwLjAuMC4wIiwgaW50KHN5cy5hcmd2WzFdKSksIFJlcXVlc3RIYW5kbGVyKQpodHRwZC5zZXJ2ZV9mb3JldmVyKCkK | base64 --decode > simple_server.py] Executing query create workload B2 in X settings priority = 1; on node Executing query create workload B2 in X settings priority = 1; on node run container_id:roottests3imdssimple-gw6-resolver-1 detach:True nothrow:False cmd: ['bash', '-c', 'python3 simple_server.py 8080 >/var/log/resolver/simple_server.log 2>/var/log/resolver/simple_server.err.log'] run container_id:roottests3imdssimple-gw6-resolver-1 detach:True nothrow:False cmd: ['bash', '-c', 'python3 simple_server.py 8080 >/var/log/resolver/simple_server.log 2>/var/log/resolver/simple_server.err.log'] Command:[docker exec roottests3imdssimple-gw6-resolver-1 bash -c python3 simple_server.py 8080 >/var/log/resolver/simple_server.log 2>/var/log/resolver/simple_server.err.log] Command:[docker exec roottests3imdssimple-gw6-resolver-1 bash -c python3 simple_server.py 8080 >/var/log/resolver/simple_server.log 2>/var/log/resolver/simple_server.err.log] run container_id:roottests3imdssimple-gw6-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8080/'] run container_id:roottests3imdssimple-gw6-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8080/'] Command:[docker exec roottests3imdssimple-gw6-resolver-1 curl -s http://localhost:8080/] Command:[docker exec roottests3imdssimple-gw6-resolver-1 curl -s http://localhost:8080/] Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Exitcode:7 Exitcode:7 Executing query create workload C2 in Y settings priority = -1; on node Executing query create workload C2 in Y settings priority = -1; on node Executing query create workload D2 in Y settings priority = 1; on node Executing query create workload D2 in Y settings priority = 1; on node Executing query SELECT * FROM `test_database`.`postgresql_replica_1` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_1` LIMIT 1 FORMAT Null on instance Executing query drop workload A1; on node Executing query drop workload A1; on node Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_1' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_1' on instance Executing query drop workload A2; on node Executing query drop workload A2; on node Executing query select * from `postgres_database`.`postgresql_replica_1` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_1` order by key; on instance Executing query drop workload B1; on node Executing query drop workload B1; on node Executing query select * from `test_database`.`postgresql_replica_1` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_1` order by key; on instance Executing query drop workload B2; on node Executing query drop workload B2; on node run container_id:roottests3imdssimple-gw6-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8080/'] run container_id:roottests3imdssimple-gw6-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8080/'] Command:[docker exec roottests3imdssimple-gw6-resolver-1 curl -s http://localhost:8080/] Command:[docker exec roottests3imdssimple-gw6-resolver-1 curl -s http://localhost:8080/] Executing query drop workload C1; on node Executing query drop workload C1; on node Executing query SELECT * FROM `test_database`.`postgresql_replica_2` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_2` LIMIT 1 FORMAT Null on instance Stdout:OK Stdout:OK simple_server.py answered OK on attempt 2 simple_server.py answered OK on attempt 2 Mock server simple_server.py started Mock server simple_server.py started Executing query INSERT INTO FUNCTION s3('http://minio1:9001/root/test1.jsonl') SELECT * FROM numbers(100) on node Executing query INSERT INTO FUNCTION s3('http://minio1:9001/root/test1.jsonl') SELECT * FROM numbers(100) on node Executing query drop workload C2; on node Executing query drop workload C2; on node Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_2' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_2' on instance Executing query SELECT count() FROM s3('http://minio1:9001/root/test1.jsonl') on node Executing query SELECT count() FROM s3('http://minio1:9001/root/test1.jsonl') on node Executing query drop workload D1; on node Executing query drop workload D1; on node Executing query select * from `postgres_database`.`postgresql_replica_2` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_2` order by key; on instance Executing query drop workload D2; on node Executing query drop workload D2; on node Executing query SYSTEM FLUSH LOGS on node Executing query SYSTEM FLUSH LOGS on node Executing query select * from `test_database`.`postgresql_replica_2` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_2` order by key; on instance Executing query create workload Z in all; on node Executing query create workload Z in all; on node Executing query SELECT * FROM `test_database`.`postgresql_replica_3` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_3` LIMIT 1 FORMAT Null on instance Executing query create workload A1 in Z settings priority = -1; on node Executing query create workload A1 in Z settings priority = -1; on node Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_3' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_3' on instance Executing query create workload A2 in Z settings priority = -1; on node Executing query create workload A2 in Z settings priority = -1; on node Executing query select * from `postgres_database`.`postgresql_replica_3` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_3` order by key; on instance run container_id:roottests3imdssimple-gw6-node-1 detach:False nothrow:False cmd: ['bash', '-c', '[ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService to get token failed, falling back to a less secure way" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true'] run container_id:roottests3imdssimple-gw6-node-1 detach:False nothrow:False cmd: ['bash', '-c', '[ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService to get token failed, falling back to a less secure way" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true'] Command:[docker exec roottests3imdssimple-gw6-node-1 bash -c [ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService to get token failed, falling back to a less secure way" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker exec roottests3imdssimple-gw6-node-1 bash -c [ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService to get token failed, falling back to a less secure way" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true] Executing query create workload A3 in Z settings priority = -1; on node Executing query create workload A3 in Z settings priority = -1; on node Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:55:44.588726 [ 9 ] {889594dc-d78f-4c01-8469-1ba701309b6c} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService to get token failed, falling back to a less secure way. HTTP response code: NOT_IMPLEMENTED Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:55:44.588726 [ 9 ] {889594dc-d78f-4c01-8469-1ba701309b6c} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService to get token failed, falling back to a less secure way. HTTP response code: NOT_IMPLEMENTED Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:55:44.817314 [ 9 ] {775c1ba5-0d7e-4788-96e7-f28354945c5d} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService to get token failed, falling back to a less secure way. HTTP response code: NOT_IMPLEMENTED Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:55:44.817314 [ 9 ] {775c1ba5-0d7e-4788-96e7-f28354945c5d} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService to get token failed, falling back to a less secure way. HTTP response code: NOT_IMPLEMENTED run container_id:roottests3imdssimple-gw6-node-1 detach:False nothrow:False cmd: ['bash', '-c', '[ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Getting default credentials for ec2 instance from resolver:8080" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true'] run container_id:roottests3imdssimple-gw6-node-1 detach:False nothrow:False cmd: ['bash', '-c', '[ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Getting default credentials for ec2 instance from resolver:8080" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true'] Command:[docker exec roottests3imdssimple-gw6-node-1 bash -c [ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Getting default credentials for ec2 instance from resolver:8080" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker exec roottests3imdssimple-gw6-node-1 bash -c [ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Getting default credentials for ec2 instance from resolver:8080" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true] Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:55:44.588768 [ 9 ] {889594dc-d78f-4c01-8469-1ba701309b6c} AWSEC2InstanceProfileConfigLoader: Getting default credentials for ec2 instance from resolver:8080 Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:55:44.588768 [ 9 ] {889594dc-d78f-4c01-8469-1ba701309b6c} AWSEC2InstanceProfileConfigLoader: Getting default credentials for ec2 instance from resolver:8080 Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:55:44.817348 [ 9 ] {775c1ba5-0d7e-4788-96e7-f28354945c5d} AWSEC2InstanceProfileConfigLoader: Getting default credentials for ec2 instance from resolver:8080 Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:55:44.817348 [ 9 ] {775c1ba5-0d7e-4788-96e7-f28354945c5d} AWSEC2InstanceProfileConfigLoader: Getting default credentials for ec2 instance from resolver:8080 run container_id:roottests3imdssimple-gw6-node-1 detach:False nothrow:False cmd: ['bash', '-c', '[ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource, /latest/meta-data/iam/security-credentials returned credential string myrole" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true'] run container_id:roottests3imdssimple-gw6-node-1 detach:False nothrow:False cmd: ['bash', '-c', '[ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource, /latest/meta-data/iam/security-credentials returned credential string myrole" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true'] Command:[docker exec roottests3imdssimple-gw6-node-1 bash -c [ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource, /latest/meta-data/iam/security-credentials returned credential string myrole" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker exec roottests3imdssimple-gw6-node-1 bash -c [ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource, /latest/meta-data/iam/security-credentials returned credential string myrole" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true] Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:55:44.589609 [ 9 ] {889594dc-d78f-4c01-8469-1ba701309b6c} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource, /latest/meta-data/iam/security-credentials returned credential string myrole. Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:55:44.589609 [ 9 ] {889594dc-d78f-4c01-8469-1ba701309b6c} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource, /latest/meta-data/iam/security-credentials returned credential string myrole. Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:55:44.818075 [ 9 ] {775c1ba5-0d7e-4788-96e7-f28354945c5d} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource, /latest/meta-data/iam/security-credentials returned credential string myrole. Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:55:44.818075 [ 9 ] {775c1ba5-0d7e-4788-96e7-f28354945c5d} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource, /latest/meta-data/iam/security-credentials returned credential string myrole. run container_id:roottests3imdssimple-gw6-node-1 detach:False nothrow:False cmd: ['bash', '-c', '[ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource /latest/meta-data/iam/security-credentials/myrole" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true'] run container_id:roottests3imdssimple-gw6-node-1 detach:False nothrow:False cmd: ['bash', '-c', '[ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource /latest/meta-data/iam/security-credentials/myrole" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true'] Command:[docker exec roottests3imdssimple-gw6-node-1 bash -c [ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource /latest/meta-data/iam/security-credentials/myrole" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker exec roottests3imdssimple-gw6-node-1 bash -c [ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource /latest/meta-data/iam/security-credentials/myrole" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true] Executing query create workload B1 in Z settings priority = 1; on node Executing query create workload B1 in Z settings priority = 1; on node Executing query select * from `test_database`.`postgresql_replica_3` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_3` order by key; on instance Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:55:44.589661 [ 9 ] {889594dc-d78f-4c01-8469-1ba701309b6c} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource /latest/meta-data/iam/security-credentials/myrole. Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:55:44.589661 [ 9 ] {889594dc-d78f-4c01-8469-1ba701309b6c} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource /latest/meta-data/iam/security-credentials/myrole. Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:55:44.818127 [ 9 ] {775c1ba5-0d7e-4788-96e7-f28354945c5d} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource /latest/meta-data/iam/security-credentials/myrole. Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:55:44.818127 [ 9 ] {775c1ba5-0d7e-4788-96e7-f28354945c5d} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource /latest/meta-data/iam/security-credentials/myrole. run container_id:roottests3imdssimple-gw6-node-1 detach:False nothrow:False cmd: ['bash', '-c', '[ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Successfully pulled credentials from EC2MetadataService with access key" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true'] run container_id:roottests3imdssimple-gw6-node-1 detach:False nothrow:False cmd: ['bash', '-c', '[ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Successfully pulled credentials from EC2MetadataService with access key" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true'] Command:[docker exec roottests3imdssimple-gw6-node-1 bash -c [ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Successfully pulled credentials from EC2MetadataService with access key" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker exec roottests3imdssimple-gw6-node-1 bash -c [ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Successfully pulled credentials from EC2MetadataService with access key" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true] Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:55:44.590371 [ 9 ] {889594dc-d78f-4c01-8469-1ba701309b6c} AWSEC2InstanceProfileConfigLoader: Successfully pulled credentials from EC2MetadataService with access key. Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:55:44.590371 [ 9 ] {889594dc-d78f-4c01-8469-1ba701309b6c} AWSEC2InstanceProfileConfigLoader: Successfully pulled credentials from EC2MetadataService with access key. Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:55:44.818864 [ 9 ] {775c1ba5-0d7e-4788-96e7-f28354945c5d} AWSEC2InstanceProfileConfigLoader: Successfully pulled credentials from EC2MetadataService with access key. Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:55:44.818864 [ 9 ] {775c1ba5-0d7e-4788-96e7-f28354945c5d} AWSEC2InstanceProfileConfigLoader: Successfully pulled credentials from EC2MetadataService with access key. Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/.env --project-name roottests3imdssimple-gw6 --file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/.env --project-name roottests3imdssimple-gw6 --file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml stop --timeout 20] [gw6] PASSED test_s3_imds/test_simple.py::test_credentials_from_metadata Stderr: Container roottestremovestalemovingparts-gw9-zoo1-1 Stopping Stderr: Container roottestremovestalemovingparts-gw9-zoo1-1 Stopping Stderr: Container roottestremovestalemovingparts-gw9-zoo1-1 Stopped Stderr: Container roottestremovestalemovingparts-gw9-zoo1-1 Stopped Stopping zookeeper node: zoo2 Stopping zookeeper node: zoo2 Command:[docker compose --project-name roottestremovestalemovingparts-gw9 --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop zoo2] Command:[docker compose --project-name roottestremovestalemovingparts-gw9 --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop zoo2] Executing query create workload B2 in Z settings priority = 1; on node Executing query create workload B2 in Z settings priority = 1; on node Executing query SELECT * FROM `test_database`.`postgresql_replica_4` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_4` LIMIT 1 FORMAT Null on instance Executing query create workload B3 in Z settings priority = 1; on node Executing query create workload B3 in Z settings priority = 1; on node Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_4' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_4' on instance Executing query create workload C1 in X settings priority = -1; on node Executing query create workload C1 in X settings priority = -1; on node Executing query select * from `postgres_database`.`postgresql_replica_4` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_4` order by key; on instance Executing query create workload C2 in X settings priority = -1; on node Executing query create workload C2 in X settings priority = -1; on node Executing query select * from `test_database`.`postgresql_replica_4` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_4` order by key; on instance Executing query create workload C3 in X settings priority = -1; on node Executing query create workload C3 in X settings priority = -1; on node Executing query SELECT key, value1, value3 FROM test_database.postgresql_replica_3 ORDER BY key on instance Executing query SELECT key, value1, value3 FROM test_database.postgresql_replica_3 ORDER BY key on instance Executing query create workload D1 in X settings priority = 1; on node Executing query create workload D1 in X settings priority = 1; on node Executing query SELECT count() FROM test_database.postgresql_replica_0 on instance Executing query SELECT count() FROM test_database.postgresql_replica_0 on instance Executing query create workload D2 in X settings priority = 1; on node Executing query create workload D2 in X settings priority = 1; on node Connection dropped: outstanding heartbeat ping not received Connection dropped: outstanding heartbeat ping not received Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Connecting to 172.16.9.4(172.16.9.4):2181, use_ssl: False Connecting to 172.16.9.4(172.16.9.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused run container_id:roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 detach:False nothrow:False cmd: ['bash', '-c', 'timeout 30 tail -Fn100 "/var/log/clickhouse-server/clickhouse-server.log" | grep -Em 1 \'Table postgresql_replica_0 is skipped from replication stream\''] run container_id:roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 detach:False nothrow:False cmd: ['bash', '-c', 'timeout 30 tail -Fn100 "/var/log/clickhouse-server/clickhouse-server.log" | grep -Em 1 \'Table postgresql_replica_0 is skipped from replication stream\''] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 bash -c timeout 30 tail -Fn100 "/var/log/clickhouse-server/clickhouse-server.log" | grep -Em 1 'Table postgresql_replica_0 is skipped from replication stream'] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 bash -c timeout 30 tail -Fn100 "/var/log/clickhouse-server/clickhouse-server.log" | grep -Em 1 'Table postgresql_replica_0 is skipped from replication stream'] Executing query create workload D3 in X settings priority = 1; on node Executing query create workload D3 in X settings priority = 1; on node Connecting to 172.16.9.4(172.16.9.4):2181, use_ssl: False Connecting to 172.16.9.4(172.16.9.4):2181, use_ssl: False Executing query drop workload A1; on node Executing query drop workload A1; on node Executing query drop workload B1; on node Executing query drop workload B1; on node Executing query drop workload C1; on node Executing query drop workload C1; on node Executing query drop workload D1; on node Executing query drop workload D1; on node Executing query drop workload A2; on node Executing query drop workload A2; on node Executing query drop workload B2; on node Executing query drop workload B2; on node Stdout:2025.04.02 02:55:48.690069 [ 1289 ] {} PostgreSQLReplicaConsumer(postgres_database): Table postgresql_replica_0 is skipped from replication stream because its structure has changes. Please detach this table and reattach to resume the replication (relation id: 16752) Stdout:2025.04.02 02:55:48.690069 [ 1289 ] {} PostgreSQLReplicaConsumer(postgres_database): Table postgresql_replica_0 is skipped from replication stream because its structure has changes. Please detach this table and reattach to resume the replication (relation id: 16752) 1 log line(s) matching "Table postgresql_replica_0 is skipped from replication stream" appeared in a 1.210 seconds 1 log line(s) matching "Table postgresql_replica_0 is skipped from replication stream" appeared in a 1.210 seconds Executing query SELECT count() FROM test_database.postgresql_replica_0 on instance Executing query SELECT count() FROM test_database.postgresql_replica_0 on instance Executing query drop workload C2; on node Executing query drop workload C2; on node Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance [gw1] PASSED test_postgresql_replica_database_engine_1/test.py::test_table_schema_changes Executing query drop workload D2; on node Executing query drop workload D2; on node Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query drop workload A3; on node Executing query drop workload A3; on node Executing query drop workload B3; on node Executing query drop workload B3; on node Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query create resource io_test (write disk non_existent_disk, read disk non_existent_disk); on node Executing query create resource io_test (write disk non_existent_disk, read disk non_existent_disk); on node test_postgresql_replica_database_engine_1/test.py::test_user_managed_slots Executing query INSERT INTO `postgres_database`.`test_table` SELECT number, number from numbers(50) on instance Executing query INSERT INTO `postgres_database`.`test_table` SELECT number, number from numbers(50) on instance Executing query drop resource io_test; on node Executing query drop resource io_test; on node Executing query drop workload C3; on node Executing query drop workload C3; on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query DROP DATABASE IF EXISTS `test_database` on instance Stderr: Container roottestreplicatedmergetreecompatibility-gw5-node1-1 Stopping Stderr: Container roottestreplicatedmergetreecompatibility-gw5-node1-1 Stopping Stderr: Container roottestreplicatedmergetreecompatibility-gw5-node2-1 Stopping Stderr: Container roottestreplicatedmergetreecompatibility-gw5-node2-1 Stopping Stderr: Container roottestreplicatedmergetreecompatibility-gw5-node2-1 Stopped Stderr: Container roottestreplicatedmergetreecompatibility-gw5-node2-1 Stopped Stderr: Container roottestreplicatedmergetreecompatibility-gw5-node1-1 Stopped Stderr: Container roottestreplicatedmergetreecompatibility-gw5-node1-1 Stopped Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo2-1 Stopping Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo2-1 Stopping Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo3-1 Stopping Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo3-1 Stopping Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo1-1 Stopping Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo1-1 Stopping Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo2-1 Stopped Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo2-1 Stopped Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo3-1 Stopped Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo3-1 Stopped Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo1-1 Stopped Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo1-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/node2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/node2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/node2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/node2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/.env --project-name roottestreplicatedmergetreecompatibility-gw5 --file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/node2/docker-compose.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/.env --project-name roottestreplicatedmergetreecompatibility-gw5 --file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw5/node2/docker-compose.yml down --volumes] Executing query drop workload D3; on node Executing query drop workload D3; on node Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') SETTINGS materialized_postgresql_replication_slot = 'user_slot', materialized_postgresql_snapshot = '000000D5-0000000E-1' on instance Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') SETTINGS materialized_postgresql_replication_slot = 'user_slot', materialized_postgresql_snapshot = '000000D5-0000000E-1' on instance Executing query drop workload X; on node Executing query drop workload X; on node Executing query SHOW DATABASES on instance Executing query SHOW DATABASES on instance Executing query drop workload Y; on node Executing query drop workload Y; on node Executing query SELECT * FROM `test_database`.`test_table` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`test_table` LIMIT 1 FORMAT Null on instance Executing query drop workload Z; on node Executing query drop workload Z; on node Executing query SHOW TABLES FROM `test_database` WHERE name = 'test_table' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'test_table' on instance Executing query drop workload all; on node Executing query drop workload all; on node Executing query select * from `postgres_database`.`test_table` order by key; on instance Executing query select * from `postgres_database`.`test_table` order by key; on instance [gw3] PASSED test_scheduler/test.py::test_workload_hierarchy_changes Command:[docker compose --env-file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/.env --project-name roottestscheduler-gw3 --file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/node2/docker-compose.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/.env --project-name roottestscheduler-gw3 --file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/node2/docker-compose.yml stop --timeout 20] Stderr: Container roottestreplicatedmergetreecompatibility-gw5-node1-1 Stopping Stderr: Container roottestreplicatedmergetreecompatibility-gw5-node1-1 Stopping Stderr: Container roottestreplicatedmergetreecompatibility-gw5-node2-1 Stopping Stderr: Container roottestreplicatedmergetreecompatibility-gw5-node2-1 Stopping Stderr: Container roottestreplicatedmergetreecompatibility-gw5-node1-1 Stopped Stderr: Container roottestreplicatedmergetreecompatibility-gw5-node1-1 Stopped Stderr: Container roottestreplicatedmergetreecompatibility-gw5-node1-1 Removing Stderr: Container roottestreplicatedmergetreecompatibility-gw5-node1-1 Removing Stderr: Container roottestreplicatedmergetreecompatibility-gw5-node2-1 Stopped Stderr: Container roottestreplicatedmergetreecompatibility-gw5-node2-1 Stopped Stderr: Container roottestreplicatedmergetreecompatibility-gw5-node2-1 Removing Stderr: Container roottestreplicatedmergetreecompatibility-gw5-node2-1 Removing Stderr: Container roottestreplicatedmergetreecompatibility-gw5-node1-1 Removed Stderr: Container roottestreplicatedmergetreecompatibility-gw5-node1-1 Removed Stderr: Container roottestreplicatedmergetreecompatibility-gw5-node2-1 Removed Stderr: Container roottestreplicatedmergetreecompatibility-gw5-node2-1 Removed Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo1-1 Stopping Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo1-1 Stopping Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo2-1 Stopping Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo2-1 Stopping Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo3-1 Stopping Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo3-1 Stopping Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo3-1 Stopped Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo3-1 Stopped Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo3-1 Removing Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo3-1 Removing Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo1-1 Stopped Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo1-1 Stopped Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo1-1 Removing Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo1-1 Removing Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo2-1 Stopped Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo2-1 Stopped Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo2-1 Removing Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo2-1 Removing Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo1-1 Removed Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo1-1 Removed Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo3-1 Removed Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo3-1 Removed Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo2-1 Removed Stderr: Container roottestreplicatedmergetreecompatibility-gw5-zoo2-1 Removed Stderr: Network roottestreplicatedmergetreecompatibility-gw5_default Removing Stderr: Network roottestreplicatedmergetreecompatibility-gw5_default Removing Stderr: Network roottestreplicatedmergetreecompatibility-gw5_default Removed Stderr: Network roottestreplicatedmergetreecompatibility-gw5_default Removed Cleanup called Cleanup called Docker networks for project roottestreplicatedmergetreecompatibility-gw5 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicatedmergetreecompatibility-gw5 are NETWORK ID NAME DRIVER SCOPE Executing query select * from `test_database`.`test_table` order by key; on instance Executing query select * from `test_database`.`test_table` order by key; on instance Docker containers for project roottestreplicatedmergetreecompatibility-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicatedmergetreecompatibility-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreplicatedmergetreecompatibility-gw5 are DRIVER VOLUME NAME Docker volumes for project roottestreplicatedmergetreecompatibility-gw5 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestreplicatedmergetreecompatibility-gw5-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestreplicatedmergetreecompatibility-gw5-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestreplicatedmergetreecompatibility-gw5 No running containers for project: roottestreplicatedmergetreecompatibility-gw5 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:13 Stdout:13 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 13 Volumes pruned: 13 test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach Running tests in /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/test.py Running tests in /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/test.py Cluster start called. is_up=False Cluster start called. is_up=False Docker networks for project roottestreplicatedparsezkmetadata-gw5 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicatedparsezkmetadata-gw5 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestreplicatedparsezkmetadata-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicatedparsezkmetadata-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreplicatedparsezkmetadata-gw5 are DRIVER VOLUME NAME Docker volumes for project roottestreplicatedparsezkmetadata-gw5 are DRIVER VOLUME NAME Cleanup called Cleanup called Executing query INSERT INTO postgres_database.test_table SELECT number, number from numbers(10000, 10000) on instance Executing query INSERT INTO postgres_database.test_table SELECT number, number from numbers(10000, 10000) on instance Docker networks for project roottestreplicatedparsezkmetadata-gw5 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicatedparsezkmetadata-gw5 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestreplicatedparsezkmetadata-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicatedparsezkmetadata-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreplicatedparsezkmetadata-gw5 are DRIVER VOLUME NAME Docker volumes for project roottestreplicatedparsezkmetadata-gw5 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestreplicatedparsezkmetadata-gw5-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestreplicatedparsezkmetadata-gw5-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestreplicatedparsezkmetadata-gw5 No running containers for project: roottestreplicatedparsezkmetadata-gw5 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:13 Stdout:13 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 13 Volumes pruned: 13 Setup directory for instance: node Setup directory for instance: node Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files [] to /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/node/configs/config.d Copy custom test config files [] to /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/node/configs/config.d Setup database dir /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/node/database Setup database dir /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/node/database Setup logs dir /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/node/logs Setup logs dir /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/node/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/keeper3/coordination'} stored in /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/keeper3/coordination'} stored in /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/.env --project-name roottestreplicatedparsezkmetadata-gw5 --file /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/.env --project-name roottestreplicatedparsezkmetadata-gw5 --file /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml pull] Executing query SELECT * FROM `test_database`.`test_table` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`test_table` LIMIT 1 FORMAT Null on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'test_table' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'test_table' on instance Stderr: Container roottests3latencylog-gw4-resolver-1 Stopping Stderr: Container roottests3latencylog-gw4-resolver-1 Stopping Stderr: Container roottests3latencylog-gw4-node-1 Stopping Stderr: Container roottests3latencylog-gw4-node-1 Stopping Stderr: Container roottests3latencylog-gw4-node-1 Stopped Stderr: Container roottests3latencylog-gw4-node-1 Stopped Stderr: Container roottests3latencylog-gw4-minio1-1 Stopping Stderr: Container roottests3latencylog-gw4-minio1-1 Stopping Stderr: Container roottests3latencylog-gw4-minio1-1 Stopped Stderr: Container roottests3latencylog-gw4-minio1-1 Stopped Stderr: Container roottests3latencylog-gw4-resolver-1 Stopped Stderr: Container roottests3latencylog-gw4-resolver-1 Stopped Stderr: Container roottests3latencylog-gw4-proxy1-1 Stopping Stderr: Container roottests3latencylog-gw4-proxy1-1 Stopping Stderr: Container roottests3latencylog-gw4-proxy2-1 Stopping Stderr: Container roottests3latencylog-gw4-proxy2-1 Stopping Stderr: Container roottests3latencylog-gw4-proxy2-1 Stopped Stderr: Container roottests3latencylog-gw4-proxy2-1 Stopped Stderr: Container roottests3latencylog-gw4-proxy1-1 Stopped Stderr: Container roottests3latencylog-gw4-proxy1-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/.env --project-name roottests3latencylog-gw4 --file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/.env --project-name roottests3latencylog-gw4 --file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml down --volumes] Executing query select * from `postgres_database`.`test_table` order by key; on instance Executing query select * from `postgres_database`.`test_table` order by key; on instance Executing query select * from `test_database`.`test_table` order by key; on instance Executing query select * from `test_database`.`test_table` order by key; on instance Stderr: Container roottests3latencylog-gw4-node-1 Stopping Stderr: Container roottests3latencylog-gw4-node-1 Stopping Stderr: Container roottests3latencylog-gw4-resolver-1 Stopping Stderr: Container roottests3latencylog-gw4-resolver-1 Stopping Stderr: Container roottests3latencylog-gw4-node-1 Stopped Stderr: Container roottests3latencylog-gw4-node-1 Stopped Stderr: Container roottests3latencylog-gw4-node-1 Removing Stderr: Container roottests3latencylog-gw4-node-1 Removing Stderr: Container roottests3latencylog-gw4-resolver-1 Stopped Stderr: Container roottests3latencylog-gw4-resolver-1 Stopped Stderr: Container roottests3latencylog-gw4-resolver-1 Removing Stderr: Container roottests3latencylog-gw4-resolver-1 Removing Stderr: Container roottests3latencylog-gw4-node-1 Removed Stderr: Container roottests3latencylog-gw4-node-1 Removed Stderr: Container roottests3latencylog-gw4-minio1-1 Stopping Stderr: Container roottests3latencylog-gw4-minio1-1 Stopping Stderr: Container roottests3latencylog-gw4-minio1-1 Stopped Stderr: Container roottests3latencylog-gw4-minio1-1 Stopped Stderr: Container roottests3latencylog-gw4-minio1-1 Removing Stderr: Container roottests3latencylog-gw4-minio1-1 Removing Stderr: Container roottests3latencylog-gw4-resolver-1 Removed Stderr: Container roottests3latencylog-gw4-resolver-1 Removed Stderr: Container roottests3latencylog-gw4-minio1-1 Removed Stderr: Container roottests3latencylog-gw4-minio1-1 Removed Stderr: Container roottests3latencylog-gw4-proxy1-1 Stopping Stderr: Container roottests3latencylog-gw4-proxy1-1 Stopping Stderr: Container roottests3latencylog-gw4-proxy2-1 Stopping Stderr: Container roottests3latencylog-gw4-proxy2-1 Stopping Stderr: Container roottests3latencylog-gw4-proxy1-1 Stopped Stderr: Container roottests3latencylog-gw4-proxy1-1 Stopped Stderr: Container roottests3latencylog-gw4-proxy1-1 Removing Stderr: Container roottests3latencylog-gw4-proxy1-1 Removing Stderr: Container roottests3latencylog-gw4-proxy2-1 Stopped Stderr: Container roottests3latencylog-gw4-proxy2-1 Stopped Stderr: Container roottests3latencylog-gw4-proxy2-1 Removing Stderr: Container roottests3latencylog-gw4-proxy2-1 Removing Stderr: Container roottests3latencylog-gw4-proxy1-1 Removed Stderr: Container roottests3latencylog-gw4-proxy1-1 Removed Stderr: Container roottests3latencylog-gw4-proxy2-1 Removed Stderr: Container roottests3latencylog-gw4-proxy2-1 Removed Stderr: Volume roottests3latencylog-gw4_data1-1 Removing Stderr: Volume roottests3latencylog-gw4_data1-1 Removing Stderr: Network roottests3latencylog-gw4_default Removing Stderr: Network roottests3latencylog-gw4_default Removing Stderr: Volume roottests3latencylog-gw4_data1-1 Removed Stderr: Volume roottests3latencylog-gw4_data1-1 Removed Stderr: Network roottests3latencylog-gw4_default Removed Stderr: Network roottests3latencylog-gw4_default Removed Cleanup called Cleanup called Docker networks for project roottests3latencylog-gw4 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3latencylog-gw4 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3latencylog-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3latencylog-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3latencylog-gw4 are DRIVER VOLUME NAME Docker volumes for project roottests3latencylog-gw4 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottests3latencylog-gw4-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottests3latencylog-gw4-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottests3latencylog-gw4 No running containers for project: roottests3latencylog-gw4 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:11 Stdout:11 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 11 Volumes pruned: 11 test_s3_storage_class/test.py::test_s3_storage_class_right Running tests in /ClickHouse/tests/integration/test_s3_storage_class/test.py Running tests in /ClickHouse/tests/integration/test_s3_storage_class/test.py Cluster start called. is_up=False Cluster start called. is_up=False Docker networks for project roottests3storageclass-gw4 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3storageclass-gw4 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3storageclass-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3storageclass-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3storageclass-gw4 are DRIVER VOLUME NAME Docker volumes for project roottests3storageclass-gw4 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker networks for project roottests3storageclass-gw4 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3storageclass-gw4 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3storageclass-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3storageclass-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3storageclass-gw4 are DRIVER VOLUME NAME Docker volumes for project roottests3storageclass-gw4 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottests3storageclass-gw4-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottests3storageclass-gw4-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottests3storageclass-gw4 No running containers for project: roottests3storageclass-gw4 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:11 Stdout:11 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 11 Volumes pruned: 11 Setup directory for instance: node Setup directory for instance: node Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_s3_storage_class/configs/config.d/minio.xml'] to /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw4/node/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_s3_storage_class/configs/config.d/minio.xml'] to /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw4/node/configs/config.d Setup database dir /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw4/node/database Setup database dir /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw4/node/database Setup logs dir /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw4/node/logs Setup logs dir /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw4/node/logs Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw4/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw4/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw4/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw4/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw4/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw4/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw4/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw4/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw4/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw4/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw4/.env --project-name roottests3storageclass-gw4 --file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw4/.env --project-name roottests3storageclass-gw4 --file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml pull] Executing query select * from `test_database`.`test_table` order by key; on instance Executing query select * from `test_database`.`test_table` order by key; on instance run container_id:roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] run container_id:roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] Command:[docker exec -u root roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 bash -c ps -C clickhouse] Command:[docker exec -u root roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 bash -c ps -C clickhouse] Stdout: PID TTY TIME CMD Stdout: PID TTY TIME CMD Stdout: 775 ? 00:00:14 clickhouse Stdout: 775 ? 00:00:14 clickhouse run container_id:roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] run container_id:roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] Command:[docker exec -u root roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 bash -c pkill clickhouse] Command:[docker exec -u root roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 bash -c pkill clickhouse] run container_id:roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:775 Stdout:775 run container_id:roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:775 Stdout:775 run container_id:roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:775 Stdout:775 run container_id:roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:775 Stdout:775 run container_id:roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:775 Stdout:775 run container_id:roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] run container_id:roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] No clickhouse process running. Start new one. No clickhouse process running. Start new one. http://localhost:None "POST /v1.46/containers/roottestpostgresqlreplicadatabaseengine1-gw1-instance-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/roottestpostgresqlreplicadatabaseengine1-gw1-instance-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/1cd33332ac6725f924bcf334a5843b48857cc7edf8a27e784cc215523a3aba23/start HTTP/1.1" 200 0 http://localhost:None "POST /v1.46/exec/1cd33332ac6725f924bcf334a5843b48857cc7edf8a27e784cc215523a3aba23/start HTTP/1.1" 200 0 http://localhost:None "GET /v1.46/exec/1cd33332ac6725f924bcf334a5843b48857cc7edf8a27e784cc215523a3aba23/json HTTP/1.1" 200 586 http://localhost:None "GET /v1.46/exec/1cd33332ac6725f924bcf334a5843b48857cc7edf8a27e784cc215523a3aba23/json HTTP/1.1" 200 586 Stderr: Container roottestremovestalemovingparts-gw9-zoo2-1 Stopping Stderr: Container roottestremovestalemovingparts-gw9-zoo2-1 Stopping Stderr: Container roottestremovestalemovingparts-gw9-zoo2-1 Stopped Stderr: Container roottestremovestalemovingparts-gw9-zoo2-1 Stopped Stopping zookeeper node: zoo3 Stopping zookeeper node: zoo3 Command:[docker compose --project-name roottestremovestalemovingparts-gw9 --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop zoo3] Command:[docker compose --project-name roottestremovestalemovingparts-gw9 --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop zoo3] run container_id:roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:1600 Stdout:1600 Clickhouse process running. Clickhouse process running. run container_id:roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:1600 Stdout:1600 Executing query select 20 on instance Executing query select 20 on instance Executing query select 20 on instance Executing query select 20 on instance Stderr: node Skipped - Image is already being pulled by zoo1 Stderr: node Skipped - Image is already being pulled by zoo1 Stderr: zoo2 Skipped - Image is already being pulled by zoo1 Stderr: zoo2 Skipped - Image is already being pulled by zoo1 Stderr: zoo3 Skipped - Image is already being pulled by zoo1 Stderr: zoo3 Skipped - Image is already being pulled by zoo1 Stderr: zoo1 Pulling Stderr: zoo1 Pulling Stderr: zoo1 Pulled Stderr: zoo1 Pulled Setup ZooKeeper Setup ZooKeeper Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/keeper1/log', '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/keeper1/config', '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/keeper1/coordination', '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/keeper2/log', '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/keeper2/config', '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/keeper2/coordination', '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/keeper3/log', '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/keeper3/config', '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/keeper3/coordination'] Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/keeper1/log', '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/keeper1/config', '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/keeper1/coordination', '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/keeper2/log', '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/keeper2/config', '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/keeper2/coordination', '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/keeper3/log', '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/keeper3/config', '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/keeper3/coordination'] Command:[docker compose --project-name roottestreplicatedparsezkmetadata-gw5 --env-file /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Command:[docker compose --project-name roottestreplicatedparsezkmetadata-gw5 --env-file /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query select 20 on instance Executing query select 20 on instance Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: minio1 Pulling Stderr: minio1 Pulling Stderr: proxy1 Pulling Stderr: proxy1 Pulling Stderr: node Pulling Stderr: node Pulling Stderr: resolver Pulling Stderr: resolver Pulling Stderr: node Pulled Stderr: node Pulled Stderr: proxy1 Pulled Stderr: proxy1 Pulled Stderr: resolver Pulled Stderr: resolver Pulled Stderr: minio1 Pulled Stderr: minio1 Pulled Trying to create Minio instance by command docker compose --project-name roottests3storageclass-gw4 --env-file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw4/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Trying to create Minio instance by command docker compose --project-name roottests3storageclass-gw4 --env-file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw4/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Command:[docker compose --project-name roottests3storageclass-gw4 --env-file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw4/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Command:[docker compose --project-name roottests3storageclass-gw4 --env-file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw4/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Executing query INSERT INTO postgres_database.test_table SELECT number, number from numbers(20000, 10000) on instance Executing query INSERT INTO postgres_database.test_table SELECT number, number from numbers(20000, 10000) on instance Stderr:time="2025-04-02T02:56:02Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:56:02Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottestreplicatedparsezkmetadata-gw5_default Creating Stderr: Network roottestreplicatedparsezkmetadata-gw5_default Creating Stderr: Network roottestreplicatedparsezkmetadata-gw5_default Created Stderr: Network roottestreplicatedparsezkmetadata-gw5_default Created Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo2-1 Creating Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo2-1 Creating Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo1-1 Creating Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo1-1 Creating Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo3-1 Creating Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo3-1 Creating Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo3-1 Created Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo3-1 Created Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo1-1 Created Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo1-1 Created Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo2-1 Created Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo2-1 Created Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo3-1 Starting Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo3-1 Starting Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo2-1 Starting Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo2-1 Starting Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo1-1 Starting Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo1-1 Starting Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo3-1 Started Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo3-1 Started Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo1-1 Started Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo1-1 Started Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo2-1 Started Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo2-1 Started Stderr:time="2025-04-02T02:56:02Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:56:02Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:56:02Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:56:02Z" level=debug msg="otel error" error="" Wait ZooKeeper to start Wait ZooKeeper to start get_instance_ip instance_name=zoo1 get_instance_ip instance_name=zoo1 http://localhost:None "GET /v1.46/containers/roottestreplicatedparsezkmetadata-gw5-zoo1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedparsezkmetadata-gw5-zoo1-1/json HTTP/1.1" 200 None get_kazoo_client: zoo1, ip:172.16.6.4, port:2181, use_ssl:False get_kazoo_client: zoo1, ip:172.16.6.4, port:2181, use_ssl:False Connecting to 172.16.6.4(172.16.6.4):2181, use_ssl: False Connecting to 172.16.6.4(172.16.6.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.6.4(172.16.6.4):2181, use_ssl: False Connecting to 172.16.6.4(172.16.6.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query SELECT * FROM `test_database`.`test_table` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`test_table` LIMIT 1 FORMAT Null on instance Connecting to 172.16.6.4(172.16.6.4):2181, use_ssl: False Connecting to 172.16.6.4(172.16.6.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query SHOW TABLES FROM `test_database` WHERE name = 'test_table' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'test_table' on instance Connecting to 172.16.6.4(172.16.6.4):2181, use_ssl: False Connecting to 172.16.6.4(172.16.6.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Stderr:time="2025-04-02T02:56:02Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:56:02Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottests3storageclass-gw4_default Creating Stderr: Network roottests3storageclass-gw4_default Creating Stderr: Network roottests3storageclass-gw4_default Created Stderr: Network roottests3storageclass-gw4_default Created Stderr: Volume "roottests3storageclass-gw4_data1-1" Creating Stderr: Volume "roottests3storageclass-gw4_data1-1" Creating Stderr: Volume "roottests3storageclass-gw4_data1-1" Created Stderr: Volume "roottests3storageclass-gw4_data1-1" Created Stderr: Container roottests3storageclass-gw4-proxy2-1 Creating Stderr: Container roottests3storageclass-gw4-proxy2-1 Creating Stderr: Container roottests3storageclass-gw4-proxy1-1 Creating Stderr: Container roottests3storageclass-gw4-proxy1-1 Creating Stderr: Container roottests3storageclass-gw4-proxy1-1 Created Stderr: Container roottests3storageclass-gw4-proxy1-1 Created Stderr: Container roottests3storageclass-gw4-proxy2-1 Created Stderr: Container roottests3storageclass-gw4-proxy2-1 Created Stderr: Container roottests3storageclass-gw4-minio1-1 Creating Stderr: Container roottests3storageclass-gw4-minio1-1 Creating Stderr: Container roottests3storageclass-gw4-resolver-1 Creating Stderr: Container roottests3storageclass-gw4-resolver-1 Creating Stderr: Container roottests3storageclass-gw4-resolver-1 Created Stderr: Container roottests3storageclass-gw4-resolver-1 Created Stderr: Container roottests3storageclass-gw4-minio1-1 Created Stderr: Container roottests3storageclass-gw4-minio1-1 Created Stderr: Container roottests3storageclass-gw4-proxy1-1 Starting Stderr: Container roottests3storageclass-gw4-proxy1-1 Starting Stderr: Container roottests3storageclass-gw4-proxy2-1 Starting Stderr: Container roottests3storageclass-gw4-proxy2-1 Starting Stderr: Container roottests3storageclass-gw4-proxy1-1 Started Stderr: Container roottests3storageclass-gw4-proxy1-1 Started Stderr: Container roottests3storageclass-gw4-proxy2-1 Started Stderr: Container roottests3storageclass-gw4-proxy2-1 Started Stderr: Container roottests3storageclass-gw4-resolver-1 Starting Stderr: Container roottests3storageclass-gw4-resolver-1 Starting Stderr: Container roottests3storageclass-gw4-minio1-1 Starting Stderr: Container roottests3storageclass-gw4-minio1-1 Starting Stderr: Container roottests3storageclass-gw4-resolver-1 Started Stderr: Container roottests3storageclass-gw4-resolver-1 Started Stderr: Container roottests3storageclass-gw4-minio1-1 Started Stderr: Container roottests3storageclass-gw4-minio1-1 Started Stderr:time="2025-04-02T02:56:03Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:56:03Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:56:03Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:56:03Z" level=debug msg="otel error" error="" Trying to connect to Minio... Trying to connect to Minio... get_instance_ip instance_name=minio1 get_instance_ip instance_name=minio1 http://localhost:None "GET /v1.46/containers/roottests3storageclass-gw4-minio1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageclass-gw4-minio1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=proxy1 get_instance_ip instance_name=proxy1 http://localhost:None "GET /v1.46/containers/roottests3storageclass-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageclass-gw4-proxy1-1/json HTTP/1.1" 200 None Starting new HTTP connection (1): 172.16.7.5:9001 Starting new HTTP connection (1): 172.16.7.5:9001 Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (2): 172.16.7.5:9001 Starting new HTTP connection (2): 172.16.7.5:9001 Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (3): 172.16.7.5:9001 Starting new HTTP connection (3): 172.16.7.5:9001 Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (4): 172.16.7.5:9001 Starting new HTTP connection (4): 172.16.7.5:9001 Can't connect to Minio: HTTPConnectionPool(host='172.16.7.5', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Can't connect to Minio: HTTPConnectionPool(host='172.16.7.5', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Executing query select * from `postgres_database`.`test_table` order by key; on instance Executing query select * from `postgres_database`.`test_table` order by key; on instance Executing query select * from `test_database`.`test_table` order by key; on instance Executing query select * from `test_database`.`test_table` order by key; on instance Connecting to 172.16.6.4(172.16.6.4):2181, use_ssl: False Connecting to 172.16.6.4(172.16.6.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance [gw1] PASSED test_postgresql_replica_database_engine_1/test.py::test_user_managed_slots Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Starting new HTTP connection (5): 172.16.7.5:9001 Starting new HTTP connection (5): 172.16.7.5:9001 http://172.16.7.5:9001 "GET / HTTP/1.1" 200 0 http://172.16.7.5:9001 "GET / HTTP/1.1" 200 0 Connected to Minio. Connected to Minio. http://172.16.7.5:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.7.5:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.7.5:9001 "PUT /root HTTP/1.1" 200 0 http://172.16.7.5:9001 "PUT /root HTTP/1.1" 200 0 S3 bucket 'root' created S3 bucket 'root' created http://172.16.7.5:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.7.5:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.7.5:9001 "PUT /root2 HTTP/1.1" 200 0 http://172.16.7.5:9001 "PUT /root2 HTTP/1.1" 200 0 S3 bucket 'root2' created S3 bucket 'root2' created ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw4/.env --project-name roottests3storageclass-gw4 --file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw4/.env --project-name roottests3storageclass-gw4 --file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw4/.env --project-name roottests3storageclass-gw4 --file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw4/.env --project-name roottests3storageclass-gw4 --file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate] Connecting to 172.16.6.4(172.16.6.4):2181, use_ssl: False Connecting to 172.16.6.4(172.16.6.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Stderr: Container roottests3storageclass-gw4-proxy2-1 Running Stderr: Container roottests3storageclass-gw4-proxy2-1 Running Stderr: Container roottests3storageclass-gw4-proxy1-1 Running Stderr: Container roottests3storageclass-gw4-proxy1-1 Running Stderr: Container roottests3storageclass-gw4-resolver-1 Running Stderr: Container roottests3storageclass-gw4-resolver-1 Running Stderr: Container roottests3storageclass-gw4-minio1-1 Running Stderr: Container roottests3storageclass-gw4-minio1-1 Running Stderr: Container roottests3storageclass-gw4-node-1 Creating Stderr: Container roottests3storageclass-gw4-node-1 Creating Stderr: Container roottests3storageclass-gw4-node-1 Created Stderr: Container roottests3storageclass-gw4-node-1 Created Stderr: Container roottests3storageclass-gw4-node-1 Starting Stderr: Container roottests3storageclass-gw4-node-1 Starting Stderr: Container roottests3storageclass-gw4-node-1 Started Stderr: Container roottests3storageclass-gw4-node-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottests3storageclass-gw4-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageclass-gw4-node-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottests3storageclass-gw4-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageclass-gw4-node-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node, ip: 172.16.7.6... Waiting for ClickHouse start in node, ip: 172.16.7.6... http://localhost:None "GET /v1.46/containers/roottests3storageclass-gw4-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageclass-gw4-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4352fa21705e17f1b6b553222dbbc70c99aec5fea0b7afef360d32bb99a3b3b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4352fa21705e17f1b6b553222dbbc70c99aec5fea0b7afef360d32bb99a3b3b5/json HTTP/1.1" 200 None test_postgresql_replica_database_engine_1/test.py::test_virtual_columns Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query DROP DATABASE IF EXISTS `test_database` on instance http://localhost:None "GET /v1.46/containers/4352fa21705e17f1b6b553222dbbc70c99aec5fea0b7afef360d32bb99a3b3b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4352fa21705e17f1b6b553222dbbc70c99aec5fea0b7afef360d32bb99a3b3b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4352fa21705e17f1b6b553222dbbc70c99aec5fea0b7afef360d32bb99a3b3b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4352fa21705e17f1b6b553222dbbc70c99aec5fea0b7afef360d32bb99a3b3b5/json HTTP/1.1" 200 None Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance http://localhost:None "GET /v1.46/containers/4352fa21705e17f1b6b553222dbbc70c99aec5fea0b7afef360d32bb99a3b3b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4352fa21705e17f1b6b553222dbbc70c99aec5fea0b7afef360d32bb99a3b3b5/json HTTP/1.1" 200 None Executing query SHOW DATABASES on instance Executing query SHOW DATABASES on instance http://localhost:None "GET /v1.46/containers/4352fa21705e17f1b6b553222dbbc70c99aec5fea0b7afef360d32bb99a3b3b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4352fa21705e17f1b6b553222dbbc70c99aec5fea0b7afef360d32bb99a3b3b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4352fa21705e17f1b6b553222dbbc70c99aec5fea0b7afef360d32bb99a3b3b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4352fa21705e17f1b6b553222dbbc70c99aec5fea0b7afef360d32bb99a3b3b5/json HTTP/1.1" 200 None Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance http://localhost:None "GET /v1.46/containers/4352fa21705e17f1b6b553222dbbc70c99aec5fea0b7afef360d32bb99a3b3b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4352fa21705e17f1b6b553222dbbc70c99aec5fea0b7afef360d32bb99a3b3b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4352fa21705e17f1b6b553222dbbc70c99aec5fea0b7afef360d32bb99a3b3b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4352fa21705e17f1b6b553222dbbc70c99aec5fea0b7afef360d32bb99a3b3b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4352fa21705e17f1b6b553222dbbc70c99aec5fea0b7afef360d32bb99a3b3b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4352fa21705e17f1b6b553222dbbc70c99aec5fea0b7afef360d32bb99a3b3b5/json HTTP/1.1" 200 None Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance http://localhost:None "GET /v1.46/containers/4352fa21705e17f1b6b553222dbbc70c99aec5fea0b7afef360d32bb99a3b3b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4352fa21705e17f1b6b553222dbbc70c99aec5fea0b7afef360d32bb99a3b3b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4352fa21705e17f1b6b553222dbbc70c99aec5fea0b7afef360d32bb99a3b3b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4352fa21705e17f1b6b553222dbbc70c99aec5fea0b7afef360d32bb99a3b3b5/json HTTP/1.1" 200 None Executing query INSERT INTO postgres_database.postgresql_replica_0 SELECT number, number from numbers(10) on instance Executing query INSERT INTO postgres_database.postgresql_replica_0 SELECT number, number from numbers(10) on instance http://localhost:None "GET /v1.46/containers/4352fa21705e17f1b6b553222dbbc70c99aec5fea0b7afef360d32bb99a3b3b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4352fa21705e17f1b6b553222dbbc70c99aec5fea0b7afef360d32bb99a3b3b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4352fa21705e17f1b6b553222dbbc70c99aec5fea0b7afef360d32bb99a3b3b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4352fa21705e17f1b6b553222dbbc70c99aec5fea0b7afef360d32bb99a3b3b5/json HTTP/1.1" 200 None Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance http://localhost:None "GET /v1.46/containers/4352fa21705e17f1b6b553222dbbc70c99aec5fea0b7afef360d32bb99a3b3b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4352fa21705e17f1b6b553222dbbc70c99aec5fea0b7afef360d32bb99a3b3b5/json HTTP/1.1" 200 None ClickHouse node started ClickHouse node started Executing query CREATE TABLE test_s3_storage_class ( `id` UInt64, `value` String ) ENGINE = MergeTree ORDER BY id SETTINGS storage_policy='use_s3_storage_class'; on node Executing query CREATE TABLE test_s3_storage_class ( `id` UInt64, `value` String ) ENGINE = MergeTree ORDER BY id SETTINGS storage_policy='use_s3_storage_class'; on node Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance Connecting to 172.16.6.4(172.16.6.4):2181, use_ssl: False Connecting to 172.16.6.4(172.16.6.4):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Executing query INSERT INTO test_s3_storage_class VALUES (1, 'a'); on node Executing query INSERT INTO test_s3_storage_class VALUES (1, 'a'); on node Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo2 get_instance_ip instance_name=zoo2 http://localhost:None "GET /v1.46/containers/roottestreplicatedparsezkmetadata-gw5-zoo2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedparsezkmetadata-gw5-zoo2-1/json HTTP/1.1" 200 None get_kazoo_client: zoo2, ip:172.16.6.3, port:2181, use_ssl:False get_kazoo_client: zoo2, ip:172.16.6.3, port:2181, use_ssl:False Connecting to 172.16.6.3(172.16.6.3):2181, use_ssl: False Connecting to 172.16.6.3(172.16.6.3):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo3 get_instance_ip instance_name=zoo3 http://localhost:None "GET /v1.46/containers/roottestreplicatedparsezkmetadata-gw5-zoo3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedparsezkmetadata-gw5-zoo3-1/json HTTP/1.1" 200 None get_kazoo_client: zoo3, ip:172.16.6.2, port:2181, use_ssl:False get_kazoo_client: zoo3, ip:172.16.6.2, port:2181, use_ssl:False Connecting to 172.16.6.2(172.16.6.2):2181, use_ssl: False Connecting to 172.16.6.2(172.16.6.2):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/.env --project-name roottestreplicatedparsezkmetadata-gw5 --file /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/.env --project-name roottestreplicatedparsezkmetadata-gw5 --file /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/.env --project-name roottestreplicatedparsezkmetadata-gw5 --file /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/.env --project-name roottestreplicatedparsezkmetadata-gw5 --file /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml up -d --no-recreate] Executing query select * from `postgres_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_0` order by key; on instance Stderr: Container roottests3imdssimple-gw6-resolver-1 Stopping Stderr: Container roottests3imdssimple-gw6-resolver-1 Stopping Stderr: Container roottests3imdssimple-gw6-node-1 Stopping Stderr: Container roottests3imdssimple-gw6-node-1 Stopping Stderr: Container roottests3imdssimple-gw6-node-1 Stopped Stderr: Container roottests3imdssimple-gw6-node-1 Stopped Stderr: Container roottests3imdssimple-gw6-minio1-1 Stopping Stderr: Container roottests3imdssimple-gw6-minio1-1 Stopping Stderr: Container roottests3imdssimple-gw6-minio1-1 Stopped Stderr: Container roottests3imdssimple-gw6-minio1-1 Stopped Stderr: Container roottests3imdssimple-gw6-resolver-1 Stopped Stderr: Container roottests3imdssimple-gw6-resolver-1 Stopped Stderr: Container roottests3imdssimple-gw6-proxy1-1 Stopping Stderr: Container roottests3imdssimple-gw6-proxy1-1 Stopping Stderr: Container roottests3imdssimple-gw6-proxy2-1 Stopping Stderr: Container roottests3imdssimple-gw6-proxy2-1 Stopping Stderr: Container roottests3imdssimple-gw6-proxy2-1 Stopped Stderr: Container roottests3imdssimple-gw6-proxy2-1 Stopped Stderr: Container roottests3imdssimple-gw6-proxy1-1 Stopped Stderr: Container roottests3imdssimple-gw6-proxy1-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/.env --project-name roottests3imdssimple-gw6 --file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/.env --project-name roottests3imdssimple-gw6 --file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml down --volumes] Executing query SELECT id FROM test_s3_storage_class; on node Executing query SELECT id FROM test_s3_storage_class; on node Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query SELECT key, value, _sign, _version FROM test_database.postgresql_replica_0; on instance Executing query SELECT key, value, _sign, _version FROM test_database.postgresql_replica_0; on instance Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw4/.env --project-name roottests3storageclass-gw4 --file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw4/.env --project-name roottests3storageclass-gw4 --file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml stop --timeout 20] [gw4] PASSED test_s3_storage_class/test.py::test_s3_storage_class_right Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo2-1 Running Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo2-1 Running Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo3-1 Running Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo3-1 Running Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo1-1 Running Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo1-1 Running Stderr: Container roottestreplicatedparsezkmetadata-gw5-node-1 Creating Stderr: Container roottestreplicatedparsezkmetadata-gw5-node-1 Creating Stderr: Container roottestreplicatedparsezkmetadata-gw5-node-1 Created Stderr: Container roottestreplicatedparsezkmetadata-gw5-node-1 Created Stderr: Container roottestreplicatedparsezkmetadata-gw5-node-1 Starting Stderr: Container roottestreplicatedparsezkmetadata-gw5-node-1 Starting Stderr: Container roottestreplicatedparsezkmetadata-gw5-node-1 Started Stderr: Container roottestreplicatedparsezkmetadata-gw5-node-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottestreplicatedparsezkmetadata-gw5-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedparsezkmetadata-gw5-node-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottestreplicatedparsezkmetadata-gw5-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedparsezkmetadata-gw5-node-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node, ip: 172.16.6.5... Waiting for ClickHouse start in node, ip: 172.16.6.5... http://localhost:None "GET /v1.46/containers/roottestreplicatedparsezkmetadata-gw5-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedparsezkmetadata-gw5-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f53105de3d0e2e137db9893ae0bef3478770182e81817f3f11217e50aa49c6ea/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f53105de3d0e2e137db9893ae0bef3478770182e81817f3f11217e50aa49c6ea/json HTTP/1.1" 200 None Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance [gw1] PASSED test_postgresql_replica_database_engine_1/test.py::test_virtual_columns http://localhost:None "GET /v1.46/containers/f53105de3d0e2e137db9893ae0bef3478770182e81817f3f11217e50aa49c6ea/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f53105de3d0e2e137db9893ae0bef3478770182e81817f3f11217e50aa49c6ea/json HTTP/1.1" 200 None Stderr: Container roottests3imdssimple-gw6-node-1 Stopping Stderr: Container roottests3imdssimple-gw6-node-1 Stopping Stderr: Container roottests3imdssimple-gw6-resolver-1 Stopping Stderr: Container roottests3imdssimple-gw6-resolver-1 Stopping Stderr: Container roottests3imdssimple-gw6-node-1 Stopped Stderr: Container roottests3imdssimple-gw6-node-1 Stopped Stderr: Container roottests3imdssimple-gw6-node-1 Removing Stderr: Container roottests3imdssimple-gw6-node-1 Removing Stderr: Container roottests3imdssimple-gw6-resolver-1 Stopped Stderr: Container roottests3imdssimple-gw6-resolver-1 Stopped Stderr: Container roottests3imdssimple-gw6-resolver-1 Removing Stderr: Container roottests3imdssimple-gw6-resolver-1 Removing Stderr: Container roottests3imdssimple-gw6-node-1 Removed Stderr: Container roottests3imdssimple-gw6-node-1 Removed Stderr: Container roottests3imdssimple-gw6-minio1-1 Stopping Stderr: Container roottests3imdssimple-gw6-minio1-1 Stopping Stderr: Container roottests3imdssimple-gw6-minio1-1 Stopped Stderr: Container roottests3imdssimple-gw6-minio1-1 Stopped Stderr: Container roottests3imdssimple-gw6-minio1-1 Removing Stderr: Container roottests3imdssimple-gw6-minio1-1 Removing Stderr: Container roottests3imdssimple-gw6-resolver-1 Removed Stderr: Container roottests3imdssimple-gw6-resolver-1 Removed Stderr: Container roottests3imdssimple-gw6-minio1-1 Removed Stderr: Container roottests3imdssimple-gw6-minio1-1 Removed Stderr: Container roottests3imdssimple-gw6-proxy2-1 Stopping Stderr: Container roottests3imdssimple-gw6-proxy2-1 Stopping Stderr: Container roottests3imdssimple-gw6-proxy1-1 Stopping Stderr: Container roottests3imdssimple-gw6-proxy1-1 Stopping Stderr: Container roottests3imdssimple-gw6-proxy2-1 Stopped Stderr: Container roottests3imdssimple-gw6-proxy2-1 Stopped Stderr: Container roottests3imdssimple-gw6-proxy2-1 Removing Stderr: Container roottests3imdssimple-gw6-proxy2-1 Removing Stderr: Container roottests3imdssimple-gw6-proxy1-1 Stopped Stderr: Container roottests3imdssimple-gw6-proxy1-1 Stopped Stderr: Container roottests3imdssimple-gw6-proxy1-1 Removing Stderr: Container roottests3imdssimple-gw6-proxy1-1 Removing Stderr: Container roottests3imdssimple-gw6-proxy2-1 Removed Stderr: Container roottests3imdssimple-gw6-proxy2-1 Removed Stderr: Container roottests3imdssimple-gw6-proxy1-1 Removed Stderr: Container roottests3imdssimple-gw6-proxy1-1 Removed Stderr: Volume roottests3imdssimple-gw6_data1-1 Removing Stderr: Volume roottests3imdssimple-gw6_data1-1 Removing Stderr: Network roottests3imdssimple-gw6_default Removing Stderr: Network roottests3imdssimple-gw6_default Removing Stderr: Volume roottests3imdssimple-gw6_data1-1 Removed Stderr: Volume roottests3imdssimple-gw6_data1-1 Removed Stderr: Network roottests3imdssimple-gw6_default Removed Stderr: Network roottests3imdssimple-gw6_default Removed Cleanup called Cleanup called Docker networks for project roottests3imdssimple-gw6 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3imdssimple-gw6 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3imdssimple-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3imdssimple-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3imdssimple-gw6 are DRIVER VOLUME NAME Docker volumes for project roottests3imdssimple-gw6 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottests3imdssimple-gw6-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottests3imdssimple-gw6-.*-1$' --format '{{.ID}}:{{.Names}}'] http://localhost:None "GET /v1.46/containers/f53105de3d0e2e137db9893ae0bef3478770182e81817f3f11217e50aa49c6ea/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f53105de3d0e2e137db9893ae0bef3478770182e81817f3f11217e50aa49c6ea/json HTTP/1.1" 200 None Unstopped containers: {} Unstopped containers: {} No running containers for project: roottests3imdssimple-gw6 No running containers for project: roottests3imdssimple-gw6 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:11 Stdout:11 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 11 Volumes pruned: 11 test_s3_storage_conf_new_proxy/test.py::test_s3_with_proxy_list[s3] ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 ENV HOSTNAME e7837a770c02 ENV HOSTNAME e7837a770c02 ENV SHLVL 0 ENV SHLVL 0 ENV HOME /root ENV HOME /root ENV OLDPWD / ENV OLDPWD / ENV DOCKER_HELPER_TAG 5dc43a6382f0 ENV DOCKER_HELPER_TAG 5dc43a6382f0 ENV PYTHONUNBUFFERED 1 ENV PYTHONUNBUFFERED 1 ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e ENV UBSAN_OPTIONS print_stacktrace=1 ENV UBSAN_OPTIONS print_stacktrace=1 ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_postgresql_replica_database_engine_1/test.py::test_different_data_types test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries test_postgresql_replica_database_engine_1/test.py::test_multiple_databases test_postgresql_replica_database_engine_1/test.py::test_quoting_1 test_postgresql_replica_database_engine_1/test.py::test_quoting_2 test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index test_postgresql_replica_database_engine_1/test.py::test_replicating_dml test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_single_transaction test_postgresql_replica_database_engine_1/test.py::test_table_schema_changes test_postgresql_replica_database_engine_1/test.py::test_user_managed_slots test_postgresql_replica_database_engine_1/test.py::test_virtual_columns test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers test_reload_client_certificate/test.py::test_correct_cn_cert test_reload_client_certificate/test.py::test_wrong_cn_cert test_reload_clusters_config/test.py::test_add_cluster test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_simple_reload test_reload_clusters_config/test.py::test_update_one_cluster test_remote_prewhere/test.py::test_remote test_remove_stale_moving_parts/test.py::test_remove_stale_moving_parts_without_zookeeper test_rename_column/test.py::test_rename_distributed test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select test_rename_column/test.py::test_rename_parallel test_rename_column/test.py::test_rename_parallel_same_node test_rename_column/test.py::test_rename_with_parallel_insert test_rename_column/test.py::test_rename_with_parallel_merges test_rename_column/test.py::test_rename_with_parallel_select test_rename_column/test.py::test_rename_with_parallel_slow_insert test_rename_column/test.py::test_rename_with_parallel_ttl_delete test_rename_column/test.py::test_rename_with_parallel_ttl_move test_replicated_merge_tree_compatibility/test.py::test_replicated_merge_tree_defaults_compatibility test_replicated_merge_tree_encrypted_disk/test.py::test_different_keys test_replicated_merge_tree_encrypted_disk/test.py::test_same_keys test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl test_replicated_merge_tree_s3_zero_copy/test.py::test_drop_table 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[0-16]' 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[8192-12]' test_replicated_merge_tree_s3_zero_copy/test.py::test_s3_check_restore test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns test_replicated_user_defined_functions/test.py::test_create_and_drop 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[false-expected_raise1]' 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[true-expected_raise0]' test_replicated_user_defined_functions/test.py::test_create_and_replace test_replicated_user_defined_functions/test.py::test_drop_if_exists test_replicated_user_defined_functions/test.py::test_reload_zookeeper test_replicated_user_defined_functions/test.py::test_replication test_replicated_user_defined_functions/test.py::test_replication_replace_by_another_node_after_creation test_replicated_user_defined_functions/test.py::test_server_restart test_replicated_user_defined_functions/test.py::test_start_without_zookeeper test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart test_restore_external_engines/test.py::test_restore_table test_restore_external_engines/test.py::test_restore_table_null test_rocksdb_options/test.py::test_invalid_block_based_table_options test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options test_s3_imds/test_session_token.py::test_credentials_from_metadata test_s3_imds/test_simple.py::test_credentials_from_metadata test_s3_latency_log/test.py::test_latency_log test_s3_low_cardinality_right_border/test.py::test_s3_right_border test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 test_s3_storage_class/test.py::test_s3_storage_class_right 'test_s3_storage_conf_new_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver]' test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy_no_proxy test_scheduler/test.py::test_create_workload test_scheduler/test.py::test_merge_workload test_scheduler/test.py::test_merge_workload_change test_scheduler/test.py::test_merge_workload_override test_scheduler/test.py::test_mutate_workload test_scheduler/test.py::test_mutation_workload_change test_scheduler/test.py::test_mutation_workload_override test_scheduler/test.py::test_resource_any_disk test_scheduler/test.py::test_resource_read_and_write test_scheduler/test.py::test_s3_disk test_scheduler/test.py::test_s3_resource_request_granularity test_scheduler/test.py::test_throw_on_unknown_workload test_scheduler/test.py::test_workload_entity_keeper_storage test_scheduler/test.py::test_workload_hierarchy_changes test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_settings_constraints_distributed/test.py::test_select_clamps_settings -vvv -ss ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_postgresql_replica_database_engine_1/test.py::test_different_data_types test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries test_postgresql_replica_database_engine_1/test.py::test_multiple_databases test_postgresql_replica_database_engine_1/test.py::test_quoting_1 test_postgresql_replica_database_engine_1/test.py::test_quoting_2 test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index test_postgresql_replica_database_engine_1/test.py::test_replicating_dml test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_single_transaction test_postgresql_replica_database_engine_1/test.py::test_table_schema_changes test_postgresql_replica_database_engine_1/test.py::test_user_managed_slots test_postgresql_replica_database_engine_1/test.py::test_virtual_columns test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers test_reload_client_certificate/test.py::test_correct_cn_cert test_reload_client_certificate/test.py::test_wrong_cn_cert test_reload_clusters_config/test.py::test_add_cluster test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_simple_reload test_reload_clusters_config/test.py::test_update_one_cluster test_remote_prewhere/test.py::test_remote test_remove_stale_moving_parts/test.py::test_remove_stale_moving_parts_without_zookeeper test_rename_column/test.py::test_rename_distributed test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select test_rename_column/test.py::test_rename_parallel test_rename_column/test.py::test_rename_parallel_same_node test_rename_column/test.py::test_rename_with_parallel_insert test_rename_column/test.py::test_rename_with_parallel_merges test_rename_column/test.py::test_rename_with_parallel_select test_rename_column/test.py::test_rename_with_parallel_slow_insert test_rename_column/test.py::test_rename_with_parallel_ttl_delete test_rename_column/test.py::test_rename_with_parallel_ttl_move test_replicated_merge_tree_compatibility/test.py::test_replicated_merge_tree_defaults_compatibility test_replicated_merge_tree_encrypted_disk/test.py::test_different_keys test_replicated_merge_tree_encrypted_disk/test.py::test_same_keys test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl test_replicated_merge_tree_s3_zero_copy/test.py::test_drop_table 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[0-16]' 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[8192-12]' test_replicated_merge_tree_s3_zero_copy/test.py::test_s3_check_restore test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns test_replicated_user_defined_functions/test.py::test_create_and_drop 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[false-expected_raise1]' 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[true-expected_raise0]' test_replicated_user_defined_functions/test.py::test_create_and_replace test_replicated_user_defined_functions/test.py::test_drop_if_exists test_replicated_user_defined_functions/test.py::test_reload_zookeeper test_replicated_user_defined_functions/test.py::test_replication test_replicated_user_defined_functions/test.py::test_replication_replace_by_another_node_after_creation test_replicated_user_defined_functions/test.py::test_server_restart test_replicated_user_defined_functions/test.py::test_start_without_zookeeper test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart test_restore_external_engines/test.py::test_restore_table test_restore_external_engines/test.py::test_restore_table_null test_rocksdb_options/test.py::test_invalid_block_based_table_options test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options test_s3_imds/test_session_token.py::test_credentials_from_metadata test_s3_imds/test_simple.py::test_credentials_from_metadata test_s3_latency_log/test.py::test_latency_log test_s3_low_cardinality_right_border/test.py::test_s3_right_border test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 test_s3_storage_class/test.py::test_s3_storage_class_right 'test_s3_storage_conf_new_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver]' test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy_no_proxy test_scheduler/test.py::test_create_workload test_scheduler/test.py::test_merge_workload test_scheduler/test.py::test_merge_workload_change test_scheduler/test.py::test_merge_workload_override test_scheduler/test.py::test_mutate_workload test_scheduler/test.py::test_mutation_workload_change test_scheduler/test.py::test_mutation_workload_override test_scheduler/test.py::test_resource_any_disk test_scheduler/test.py::test_resource_read_and_write test_scheduler/test.py::test_s3_disk test_scheduler/test.py::test_s3_resource_request_granularity test_scheduler/test.py::test_throw_on_unknown_workload test_scheduler/test.py::test_workload_entity_keeper_storage test_scheduler/test.py::test_workload_hierarchy_changes test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_settings_constraints_distributed/test.py::test_select_clamps_settings -vvv -ss ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge ENV COMPOSE_HTTP_TIMEOUT 600 ENV COMPOSE_HTTP_TIMEOUT 600 ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 ENV CLICKHOUSE_USE_OLD_ANALYZER 1 ENV CLICKHOUSE_USE_OLD_ANALYZER 1 ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ENV DOCKER_KERBERIZED_HADOOP_TAG latest ENV DOCKER_KERBERIZED_HADOOP_TAG latest ENV DOCKER_CHANNEL stable ENV DOCKER_CHANNEL stable ENV DOCKER_CLIENT_TIMEOUT 300 ENV DOCKER_CLIENT_TIMEOUT 300 ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e ENV PWD /ClickHouse/tests/integration ENV PWD /ClickHouse/tests/integration ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config ENV TZ Etc/UTC ENV TZ Etc/UTC ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java ENV DOCKER_BASE_TAG 8b2301119731 ENV DOCKER_BASE_TAG 8b2301119731 ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 ENV LC_CTYPE C.UTF-8 ENV LC_CTYPE C.UTF-8 ENV INTEGRATION_TESTS_RUN_ID 0 ENV INTEGRATION_TESTS_RUN_ID 0 ENV WORKER_FREE_PORTS 30300 30301 30302 30303 30304 30305 30306 30307 30308 30309 30310 30311 30312 30313 30314 30315 30316 30317 30318 30319 30320 30321 30322 30323 30324 30325 30326 30327 30328 30329 30330 30331 30332 30333 30334 30335 30336 30337 30338 30339 30340 30341 30342 30343 30344 30345 30346 30347 30348 30349 ENV WORKER_FREE_PORTS 30300 30301 30302 30303 30304 30305 30306 30307 30308 30309 30310 30311 30312 30313 30314 30315 30316 30317 30318 30319 30320 30321 30322 30323 30324 30325 30326 30327 30328 30329 30330 30331 30332 30333 30334 30335 30336 30337 30338 30339 30340 30341 30342 30343 30344 30345 30346 30347 30348 30349 ENV PYTEST_XDIST_TESTRUNUID abec1c7124634c26ad4fb6ef8710757d ENV PYTEST_XDIST_TESTRUNUID abec1c7124634c26ad4fb6ef8710757d ENV PYTEST_XDIST_WORKER gw6 ENV PYTEST_XDIST_WORKER gw6 ENV PYTEST_XDIST_WORKER_COUNT 10 ENV PYTEST_XDIST_WORKER_COUNT 10 ENV SSL_CERT_FILE /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/minio/certs/public.crt ENV SSL_CERT_FILE /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/minio/certs/public.crt ENV PYTEST_CURRENT_TEST test_s3_storage_conf_new_proxy/test.py::test_s3_with_proxy_list[s3] (setup) ENV PYTEST_CURRENT_TEST test_s3_storage_conf_new_proxy/test.py::test_s3_with_proxy_list[s3] (setup) CLUSTER INIT base_config_dir:/clickhouse-config CLUSTER INIT base_config_dir:/clickhouse-config clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log Cluster name: project_name:roottests3storageconfnewproxy-gw6. Added instance name:node tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/.env', '--project-name', 'roottests3storageconfnewproxy-gw6', '--file', '/ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Cluster name: project_name:roottests3storageconfnewproxy-gw6. Added instance name:node tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/.env', '--project-name', 'roottests3storageconfnewproxy-gw6', '--file', '/ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Starting cluster... Starting cluster... Running tests in /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/test.py Running tests in /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/test.py Cluster start called. is_up=False Cluster start called. is_up=False Docker networks for project roottests3storageconfnewproxy-gw6 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3storageconfnewproxy-gw6 are NETWORK ID NAME DRIVER SCOPE Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance http://localhost:None "GET /v1.46/containers/f53105de3d0e2e137db9893ae0bef3478770182e81817f3f11217e50aa49c6ea/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f53105de3d0e2e137db9893ae0bef3478770182e81817f3f11217e50aa49c6ea/json HTTP/1.1" 200 None Docker containers for project roottests3storageconfnewproxy-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3storageconfnewproxy-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3storageconfnewproxy-gw6 are DRIVER VOLUME NAME Docker volumes for project roottests3storageconfnewproxy-gw6 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker networks for project roottests3storageconfnewproxy-gw6 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3storageconfnewproxy-gw6 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3storageconfnewproxy-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3storageconfnewproxy-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3storageconfnewproxy-gw6 are DRIVER VOLUME NAME Docker volumes for project roottests3storageconfnewproxy-gw6 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottests3storageconfnewproxy-gw6-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottests3storageconfnewproxy-gw6-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottests3storageconfnewproxy-gw6 No running containers for project: roottests3storageconfnewproxy-gw6 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] http://localhost:None "GET /v1.46/containers/f53105de3d0e2e137db9893ae0bef3478770182e81817f3f11217e50aa49c6ea/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f53105de3d0e2e137db9893ae0bef3478770182e81817f3f11217e50aa49c6ea/json HTTP/1.1" 200 None Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:11 Stdout:11 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 11 Volumes pruned: 11 Setup directory for instance: node Setup directory for instance: node Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/configs/config.d/storage_conf.xml', '/ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/configs/config.d/proxy_list.xml'] to /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/node/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/configs/config.d/storage_conf.xml', '/ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/configs/config.d/proxy_list.xml'] to /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/node/configs/config.d Setup database dir /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/node/database Setup database dir /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/node/database Setup logs dir /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/node/logs Setup logs dir /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/node/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/.env --project-name roottests3storageconfnewproxy-gw6 --file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/.env --project-name roottests3storageconfnewproxy-gw6 --file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml pull] http://localhost:None "GET /v1.46/containers/f53105de3d0e2e137db9893ae0bef3478770182e81817f3f11217e50aa49c6ea/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f53105de3d0e2e137db9893ae0bef3478770182e81817f3f11217e50aa49c6ea/json HTTP/1.1" 200 None Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance http://localhost:None "GET /v1.46/containers/f53105de3d0e2e137db9893ae0bef3478770182e81817f3f11217e50aa49c6ea/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f53105de3d0e2e137db9893ae0bef3478770182e81817f3f11217e50aa49c6ea/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f53105de3d0e2e137db9893ae0bef3478770182e81817f3f11217e50aa49c6ea/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f53105de3d0e2e137db9893ae0bef3478770182e81817f3f11217e50aa49c6ea/json HTTP/1.1" 200 None Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.5.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance http://localhost:None "GET /v1.46/containers/f53105de3d0e2e137db9893ae0bef3478770182e81817f3f11217e50aa49c6ea/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f53105de3d0e2e137db9893ae0bef3478770182e81817f3f11217e50aa49c6ea/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f53105de3d0e2e137db9893ae0bef3478770182e81817f3f11217e50aa49c6ea/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f53105de3d0e2e137db9893ae0bef3478770182e81817f3f11217e50aa49c6ea/json HTTP/1.1" 200 None Command:[docker compose --env-file /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw1/.env --project-name roottestpostgresqlreplicadatabaseengine1-gw1 --file /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw1/instance/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_postgres.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw1/.env --project-name roottestpostgresqlreplicadatabaseengine1-gw1 --file /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw1/instance/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_postgres.yml stop --timeout 20] http://localhost:None "GET /v1.46/containers/f53105de3d0e2e137db9893ae0bef3478770182e81817f3f11217e50aa49c6ea/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f53105de3d0e2e137db9893ae0bef3478770182e81817f3f11217e50aa49c6ea/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f53105de3d0e2e137db9893ae0bef3478770182e81817f3f11217e50aa49c6ea/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f53105de3d0e2e137db9893ae0bef3478770182e81817f3f11217e50aa49c6ea/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f53105de3d0e2e137db9893ae0bef3478770182e81817f3f11217e50aa49c6ea/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f53105de3d0e2e137db9893ae0bef3478770182e81817f3f11217e50aa49c6ea/json HTTP/1.1" 200 None ClickHouse node started ClickHouse node started Executing query CREATE TABLE data ( key Int, INDEX key_idx0 key+0 TYPE minmax GRANULARITY 1, INDEX key_idx1 key+1 TYPE minmax GRANULARITY 1 ) ENGINE = ReplicatedMergeTree('/ch/tables/default/data', 'node') ORDER BY key; on node Executing query CREATE TABLE data ( key Int, INDEX key_idx0 key+0 TYPE minmax GRANULARITY 1, INDEX key_idx1 key+1 TYPE minmax GRANULARITY 1 ) ENGINE = ReplicatedMergeTree('/ch/tables/default/data', 'node') ORDER BY key; on node Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw1-postgres1-1 Stopping Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw1-postgres1-1 Stopping Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 Stopping Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 Stopping Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw1-postgres1-1 Stopped Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw1-postgres1-1 Stopped Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 Stopped Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw1/instance/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw1/instance/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw1/instance/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw1/instance/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw1/.env --project-name roottestpostgresqlreplicadatabaseengine1-gw1 --file /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw1/instance/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_postgres.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw1/.env --project-name roottestpostgresqlreplicadatabaseengine1-gw1 --file /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw1/instance/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_postgres.yml down --volumes] Executing query DETACH TABLE data on node Executing query DETACH TABLE data on node get_instance_ip instance_name=zoo1 get_instance_ip instance_name=zoo1 http://localhost:None "GET /v1.46/containers/roottestreplicatedparsezkmetadata-gw5-zoo1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedparsezkmetadata-gw5-zoo1-1/json HTTP/1.1" 200 None get_kazoo_client: zoo1, ip:172.16.6.4, port:2181, use_ssl:False get_kazoo_client: zoo1, ip:172.16.6.4, port:2181, use_ssl:False Connecting to 172.16.6.4(172.16.6.4):2181, use_ssl: False Connecting to 172.16.6.4(172.16.6.4):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): SetData(path='/ch/tables/default/data/replicas/node/metadata', data=b'metadata format version: 1\ndate column: \nsampling expression: \nindex granularity: 8192\nmode: 0\nsign column: \nprimary key: key\ndata format version: 1\npartition key: \nindices: key_idx0 key + 0 TYPE minmax GRANULARITY 1, key_idx1 key + 1 TYPE minmax GRANULARITY 1\ngranularity bytes: 10485760\n\n', version=-1) Sending request(xid=1): SetData(path='/ch/tables/default/data/replicas/node/metadata', data=b'metadata format version: 1\ndate column: \nsampling expression: \nindex granularity: 8192\nmode: 0\nsign column: \nprimary key: key\ndata format version: 1\npartition key: \nindices: key_idx0 key + 0 TYPE minmax GRANULARITY 1, key_idx1 key + 1 TYPE minmax GRANULARITY 1\ngranularity bytes: 10485760\n\n', version=-1) Received response(xid=1): ZnodeStat(czxid=10, mzxid=28, ctime=1743562568650, mtime=1743562569147, version=1, cversion=0, aversion=0, ephemeralOwner=0, dataLength=292, numChildren=0, pzxid=10) Received response(xid=1): ZnodeStat(czxid=10, mzxid=28, ctime=1743562568650, mtime=1743562569147, version=1, cversion=0, aversion=0, ephemeralOwner=0, dataLength=292, numChildren=0, pzxid=10) Executing query ATTACH TABLE data on node Executing query ATTACH TABLE data on node Stderr: Container roottestremovestalemovingparts-gw9-zoo3-1 Stopping Stderr: Container roottestremovestalemovingparts-gw9-zoo3-1 Stopping Stderr: Container roottestremovestalemovingparts-gw9-zoo3-1 Stopped Stderr: Container roottestremovestalemovingparts-gw9-zoo3-1 Stopped Executing query SYSTEM STOP MOVES on ch1 Executing query SYSTEM STOP MOVES on ch1 Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 Stopping Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 Stopping Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw1-postgres1-1 Stopping Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw1-postgres1-1 Stopping Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 Stopped Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 Stopped Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 Removing Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 Removing Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw1-postgres1-1 Stopped Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw1-postgres1-1 Stopped Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw1-postgres1-1 Removing Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw1-postgres1-1 Removing Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 Removed Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw1-instance-1 Removed Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw1-postgres1-1 Removed Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw1-postgres1-1 Removed Stderr: Network roottestpostgresqlreplicadatabaseengine1-gw1_default Removing Stderr: Network roottestpostgresqlreplicadatabaseengine1-gw1_default Removing Stderr: Network roottestpostgresqlreplicadatabaseengine1-gw1_default Removed Stderr: Network roottestpostgresqlreplicadatabaseengine1-gw1_default Removed Cleanup called Cleanup called Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/.env --project-name roottestreplicatedparsezkmetadata-gw5 --file /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/.env --project-name roottestreplicatedparsezkmetadata-gw5 --file /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop --timeout 20] [gw5] PASSED test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach Docker networks for project roottestpostgresqlreplicadatabaseengine1-gw1 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestpostgresqlreplicadatabaseengine1-gw1 are NETWORK ID NAME DRIVER SCOPE Executing query SYSTEM DISABLE FAILPOINT stop_moving_part_before_swap_with_active on ch1 Executing query SYSTEM DISABLE FAILPOINT stop_moving_part_before_swap_with_active on ch1 Docker containers for project roottestpostgresqlreplicadatabaseengine1-gw1 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestpostgresqlreplicadatabaseengine1-gw1 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestpostgresqlreplicadatabaseengine1-gw1 are DRIVER VOLUME NAME Docker volumes for project roottestpostgresqlreplicadatabaseengine1-gw1 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestpostgresqlreplicadatabaseengine1-gw1-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestpostgresqlreplicadatabaseengine1-gw1-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestpostgresqlreplicadatabaseengine1-gw1 No running containers for project: roottestpostgresqlreplicadatabaseengine1-gw1 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:10 Stdout:10 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 10 Volumes pruned: 10 run container_id:roottestremovestalemovingparts-gw9-ch1-1 detach:False nothrow:False cmd: ['bash', '-c', 'ls /var/lib/clickhouse/disks/s3/store/cbd/cbdd4f1a-cec1-42c2-99da-3c552d3120ea/moving'] run container_id:roottestremovestalemovingparts-gw9-ch1-1 detach:False nothrow:False cmd: ['bash', '-c', 'ls /var/lib/clickhouse/disks/s3/store/cbd/cbdd4f1a-cec1-42c2-99da-3c552d3120ea/moving'] Command:[docker exec roottestremovestalemovingparts-gw9-ch1-1 bash -c ls /var/lib/clickhouse/disks/s3/store/cbd/cbdd4f1a-cec1-42c2-99da-3c552d3120ea/moving] Command:[docker exec roottestremovestalemovingparts-gw9-ch1-1 bash -c ls /var/lib/clickhouse/disks/s3/store/cbd/cbdd4f1a-cec1-42c2-99da-3c552d3120ea/moving] Starting zookeeper node: zoo1 Starting zookeeper node: zoo1 Command:[docker compose --project-name roottestremovestalemovingparts-gw9 --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml start zoo1] Command:[docker compose --project-name roottestremovestalemovingparts-gw9 --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml start zoo1] Stderr: Container roottestremovestalemovingparts-gw9-zoo1-1 Starting Stderr: Container roottestremovestalemovingparts-gw9-zoo1-1 Starting Stderr: Container roottestremovestalemovingparts-gw9-zoo1-1 Started Stderr: Container roottestremovestalemovingparts-gw9-zoo1-1 Started Starting zookeeper node: zoo2 Starting zookeeper node: zoo2 Command:[docker compose --project-name roottestremovestalemovingparts-gw9 --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml start zoo2] Command:[docker compose --project-name roottestremovestalemovingparts-gw9 --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml start zoo2] Stderr: Container roottestremovestalemovingparts-gw9-zoo2-1 Starting Stderr: Container roottestremovestalemovingparts-gw9-zoo2-1 Starting Stderr: Container roottestremovestalemovingparts-gw9-zoo2-1 Started Stderr: Container roottestremovestalemovingparts-gw9-zoo2-1 Started Starting zookeeper node: zoo3 Starting zookeeper node: zoo3 Command:[docker compose --project-name roottestremovestalemovingparts-gw9 --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml start zoo3] Command:[docker compose --project-name roottestremovestalemovingparts-gw9 --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml start zoo3] Stderr: Container roottestremovestalemovingparts-gw9-zoo3-1 Starting Stderr: Container roottestremovestalemovingparts-gw9-zoo3-1 Starting Stderr: Container roottestremovestalemovingparts-gw9-zoo3-1 Started Stderr: Container roottestremovestalemovingparts-gw9-zoo3-1 Started get_instance_ip instance_name=zoo1 get_instance_ip instance_name=zoo1 http://localhost:None "GET /v1.46/containers/roottestremovestalemovingparts-gw9-zoo1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestremovestalemovingparts-gw9-zoo1-1/json HTTP/1.1" 200 None get_kazoo_client: zoo1, ip:172.16.1.2, port:2181, use_ssl:False get_kazoo_client: zoo1, ip:172.16.1.2, port:2181, use_ssl:False Connecting to 172.16.1.2(172.16.1.2):2181, use_ssl: False Connecting to 172.16.1.2(172.16.1.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.1.2(172.16.1.2):2181, use_ssl: False Connecting to 172.16.1.2(172.16.1.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.1.2(172.16.1.2):2181, use_ssl: False Connecting to 172.16.1.2(172.16.1.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.1.2(172.16.1.2):2181, use_ssl: False Connecting to 172.16.1.2(172.16.1.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.1.2(172.16.1.2):2181, use_ssl: False Connecting to 172.16.1.2(172.16.1.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Stderr: Container roottestscheduler-gw3-node2-1 Stopping Stderr: Container roottestscheduler-gw3-node2-1 Stopping Stderr: Container roottestscheduler-gw3-resolver-1 Stopping Stderr: Container roottestscheduler-gw3-resolver-1 Stopping Stderr: Container roottestscheduler-gw3-node-1 Stopping Stderr: Container roottestscheduler-gw3-node-1 Stopping Stderr: Container roottestscheduler-gw3-node2-1 Stopped Stderr: Container roottestscheduler-gw3-node2-1 Stopped Stderr: Container roottestscheduler-gw3-node-1 Stopped Stderr: Container roottestscheduler-gw3-node-1 Stopped Stderr: Container roottestscheduler-gw3-zoo2-1 Stopping Stderr: Container roottestscheduler-gw3-zoo2-1 Stopping Stderr: Container roottestscheduler-gw3-minio1-1 Stopping Stderr: Container roottestscheduler-gw3-minio1-1 Stopping Stderr: Container roottestscheduler-gw3-zoo3-1 Stopping Stderr: Container roottestscheduler-gw3-zoo3-1 Stopping Stderr: Container roottestscheduler-gw3-zoo1-1 Stopping Stderr: Container roottestscheduler-gw3-zoo1-1 Stopping Stderr: Container roottestscheduler-gw3-minio1-1 Stopped Stderr: Container roottestscheduler-gw3-minio1-1 Stopped Stderr: Container roottestscheduler-gw3-zoo3-1 Stopped Stderr: Container roottestscheduler-gw3-zoo3-1 Stopped Stderr: Container roottestscheduler-gw3-zoo2-1 Stopped Stderr: Container roottestscheduler-gw3-zoo2-1 Stopped Stderr: Container roottestscheduler-gw3-zoo1-1 Stopped Stderr: Container roottestscheduler-gw3-zoo1-1 Stopped Stderr: Container roottestscheduler-gw3-resolver-1 Stopped Stderr: Container roottestscheduler-gw3-resolver-1 Stopped Stderr: Container roottestscheduler-gw3-proxy2-1 Stopping Stderr: Container roottestscheduler-gw3-proxy2-1 Stopping Stderr: Container roottestscheduler-gw3-proxy1-1 Stopping Stderr: Container roottestscheduler-gw3-proxy1-1 Stopping Stderr: Container roottestscheduler-gw3-proxy1-1 Stopped Stderr: Container roottestscheduler-gw3-proxy1-1 Stopped Stderr: Container roottestscheduler-gw3-proxy2-1 Stopped Stderr: Container roottestscheduler-gw3-proxy2-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/node2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/node2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/node2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/node2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/.env --project-name roottestscheduler-gw3 --file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/node2/docker-compose.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/.env --project-name roottestscheduler-gw3 --file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw3/node2/docker-compose.yml down --volumes] Stderr: Container roottestscheduler-gw3-resolver-1 Stopping Stderr: Container roottestscheduler-gw3-resolver-1 Stopping Stderr: Container roottestscheduler-gw3-node-1 Stopping Stderr: Container roottestscheduler-gw3-node-1 Stopping Stderr: Container roottestscheduler-gw3-node2-1 Stopping Stderr: Container roottestscheduler-gw3-node2-1 Stopping Stderr: Container roottestscheduler-gw3-resolver-1 Stopped Stderr: Container roottestscheduler-gw3-resolver-1 Stopped Stderr: Container roottestscheduler-gw3-resolver-1 Removing Stderr: Container roottestscheduler-gw3-resolver-1 Removing Stderr: Container roottestscheduler-gw3-node-1 Stopped Stderr: Container roottestscheduler-gw3-node-1 Stopped Stderr: Container roottestscheduler-gw3-node-1 Removing Stderr: Container roottestscheduler-gw3-node-1 Removing Stderr: Container roottestscheduler-gw3-node2-1 Stopped Stderr: Container roottestscheduler-gw3-node2-1 Stopped Stderr: Container roottestscheduler-gw3-node2-1 Removing Stderr: Container roottestscheduler-gw3-node2-1 Removing Stderr: Container roottestscheduler-gw3-node-1 Removed Stderr: Container roottestscheduler-gw3-node-1 Removed Stderr: Container roottestscheduler-gw3-resolver-1 Removed Stderr: Container roottestscheduler-gw3-resolver-1 Removed Stderr: Container roottestscheduler-gw3-node2-1 Removed Stderr: Container roottestscheduler-gw3-node2-1 Removed Stderr: Container roottestscheduler-gw3-zoo3-1 Stopping Stderr: Container roottestscheduler-gw3-zoo3-1 Stopping Stderr: Container roottestscheduler-gw3-zoo1-1 Stopping Stderr: Container roottestscheduler-gw3-zoo1-1 Stopping Stderr: Container roottestscheduler-gw3-minio1-1 Stopping Stderr: Container roottestscheduler-gw3-minio1-1 Stopping Stderr: Container roottestscheduler-gw3-zoo2-1 Stopping Stderr: Container roottestscheduler-gw3-zoo2-1 Stopping Stderr: Container roottestscheduler-gw3-zoo1-1 Stopped Stderr: Container roottestscheduler-gw3-zoo1-1 Stopped Stderr: Container roottestscheduler-gw3-zoo1-1 Removing Stderr: Container roottestscheduler-gw3-zoo1-1 Removing Stderr: Container roottestscheduler-gw3-zoo3-1 Stopped Stderr: Container roottestscheduler-gw3-zoo3-1 Stopped Stderr: Container roottestscheduler-gw3-minio1-1 Stopped Stderr: Container roottestscheduler-gw3-minio1-1 Stopped Stderr: Container roottestscheduler-gw3-minio1-1 Removing Stderr: Container roottestscheduler-gw3-minio1-1 Removing Stderr: Container roottestscheduler-gw3-zoo2-1 Stopped Stderr: Container roottestscheduler-gw3-zoo2-1 Stopped Stderr: Container roottestscheduler-gw3-zoo2-1 Removing Stderr: Container roottestscheduler-gw3-zoo2-1 Removing Stderr: Container roottestscheduler-gw3-zoo3-1 Removing Stderr: Container roottestscheduler-gw3-zoo3-1 Removing Stderr: Container roottestscheduler-gw3-zoo1-1 Removed Stderr: Container roottestscheduler-gw3-zoo1-1 Removed Stderr: Container roottestscheduler-gw3-zoo2-1 Removed Stderr: Container roottestscheduler-gw3-zoo2-1 Removed Stderr: Container roottestscheduler-gw3-zoo3-1 Removed Stderr: Container roottestscheduler-gw3-zoo3-1 Removed Stderr: Container roottestscheduler-gw3-minio1-1 Removed Stderr: Container roottestscheduler-gw3-minio1-1 Removed Stderr: Container roottestscheduler-gw3-proxy2-1 Stopping Stderr: Container roottestscheduler-gw3-proxy2-1 Stopping Stderr: Container roottestscheduler-gw3-proxy1-1 Stopping Stderr: Container roottestscheduler-gw3-proxy1-1 Stopping Stderr: Container roottestscheduler-gw3-proxy2-1 Stopped Stderr: Container roottestscheduler-gw3-proxy2-1 Stopped Stderr: Container roottestscheduler-gw3-proxy2-1 Removing Stderr: Container roottestscheduler-gw3-proxy2-1 Removing Stderr: Container roottestscheduler-gw3-proxy1-1 Stopped Stderr: Container roottestscheduler-gw3-proxy1-1 Stopped Stderr: Container roottestscheduler-gw3-proxy1-1 Removing Stderr: Container roottestscheduler-gw3-proxy1-1 Removing Stderr: Container roottestscheduler-gw3-proxy2-1 Removed Stderr: Container roottestscheduler-gw3-proxy2-1 Removed Stderr: Container roottestscheduler-gw3-proxy1-1 Removed Stderr: Container roottestscheduler-gw3-proxy1-1 Removed Stderr: Volume roottestscheduler-gw3_data1-1 Removing Stderr: Volume roottestscheduler-gw3_data1-1 Removing Stderr: Network roottestscheduler-gw3_default Removing Stderr: Network roottestscheduler-gw3_default Removing Stderr: Volume roottestscheduler-gw3_data1-1 Removed Stderr: Volume roottestscheduler-gw3_data1-1 Removed Stderr: Network roottestscheduler-gw3_default Removed Stderr: Network roottestscheduler-gw3_default Removed Cleanup called Cleanup called Docker networks for project roottestscheduler-gw3 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestscheduler-gw3 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestscheduler-gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestscheduler-gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestscheduler-gw3 are DRIVER VOLUME NAME Docker volumes for project roottestscheduler-gw3 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestscheduler-gw3-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestscheduler-gw3-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestscheduler-gw3 No running containers for project: roottestscheduler-gw3 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:8 Stdout:8 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 8 Volumes pruned: 8 test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log Setup Keeper Setup Keeper Cluster name: project_name:roottestreplicatedmergetreereplicateddbttl-gw3. Added instance name:node1 tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/.env', '--project-name', 'roottestreplicatedmergetreereplicateddbttl-gw3', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Cluster name: project_name:roottestreplicatedmergetreereplicateddbttl-gw3. Added instance name:node1 tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/.env', '--project-name', 'roottestreplicatedmergetreereplicateddbttl-gw3', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Running tests in /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/test.py Running tests in /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/test.py Cluster start called. is_up=False Cluster start called. is_up=False Docker networks for project roottestreplicatedmergetreereplicateddbttl-gw3 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicatedmergetreereplicateddbttl-gw3 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestreplicatedmergetreereplicateddbttl-gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicatedmergetreereplicateddbttl-gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreplicatedmergetreereplicateddbttl-gw3 are DRIVER VOLUME NAME Docker volumes for project roottestreplicatedmergetreereplicateddbttl-gw3 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker networks for project roottestreplicatedmergetreereplicateddbttl-gw3 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicatedmergetreereplicateddbttl-gw3 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestreplicatedmergetreereplicateddbttl-gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicatedmergetreereplicateddbttl-gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreplicatedmergetreereplicateddbttl-gw3 are DRIVER VOLUME NAME Docker volumes for project roottestreplicatedmergetreereplicateddbttl-gw3 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestreplicatedmergetreereplicateddbttl-gw3-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestreplicatedmergetreereplicateddbttl-gw3-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestreplicatedmergetreereplicateddbttl-gw3 No running containers for project: roottestreplicatedmergetreereplicateddbttl-gw3 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:8 Stdout:8 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 8 Volumes pruned: 8 Setup directory for instance: node1 Setup directory for instance: node1 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/configs/node1_macro.xml'] to /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/node1/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/configs/node1_macro.xml'] to /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/node1/configs/config.d Setup database dir /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/node1/database Setup database dir /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/node1/database Setup logs dir /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/node1/logs Setup logs dir /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/node1/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper3/coordination', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper3/coordination', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/.env --project-name roottestreplicatedmergetreereplicateddbttl-gw3 --file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/.env --project-name roottestreplicatedmergetreereplicateddbttl-gw3 --file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml pull] Connecting to 172.16.1.2(172.16.1.2):2181, use_ssl: False Connecting to 172.16.1.2(172.16.1.2):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper', 'clickhouse'] Received response(xid=1): ['keeper', 'clickhouse'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo2 get_instance_ip instance_name=zoo2 http://localhost:None "GET /v1.46/containers/roottestremovestalemovingparts-gw9-zoo2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestremovestalemovingparts-gw9-zoo2-1/json HTTP/1.1" 200 None get_kazoo_client: zoo2, ip:172.16.1.3, port:2181, use_ssl:False get_kazoo_client: zoo2, ip:172.16.1.3, port:2181, use_ssl:False Connecting to 172.16.1.3(172.16.1.3):2181, use_ssl: False Connecting to 172.16.1.3(172.16.1.3):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper', 'clickhouse'] Received response(xid=1): ['keeper', 'clickhouse'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo3 get_instance_ip instance_name=zoo3 http://localhost:None "GET /v1.46/containers/roottestremovestalemovingparts-gw9-zoo3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestremovestalemovingparts-gw9-zoo3-1/json HTTP/1.1" 200 None get_kazoo_client: zoo3, ip:172.16.1.4, port:2181, use_ssl:False get_kazoo_client: zoo3, ip:172.16.1.4, port:2181, use_ssl:False Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper', 'clickhouse'] Received response(xid=1): ['keeper', 'clickhouse'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED All instances of ZooKeeper started: ['zoo1', 'zoo2', 'zoo3'] All instances of ZooKeeper started: ['zoo1', 'zoo2', 'zoo3'] Executing query SYSTEM START MOVES on ch1 Executing query SYSTEM START MOVES on ch1 Executing query DROP TABLE test_remove on ch1 Executing query DROP TABLE test_remove on ch1 Command:[docker compose --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/.env --project-name roottestremovestalemovingparts-gw9 --file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/ch1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/.env --project-name roottestremovestalemovingparts-gw9 --file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/ch1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml stop --timeout 20] [gw9] PASSED test_remove_stale_moving_parts/test.py::test_remove_stale_moving_parts_without_zookeeper Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Connection dropped: socket connection error: None Connection dropped: socket connection error: None Connecting to 172.16.9.4(172.16.9.4):2181, use_ssl: False Connecting to 172.16.9.4(172.16.9.4):2181, use_ssl: False Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: zoo1 Skipped - Image is already being pulled by node1 Stderr: zoo1 Skipped - Image is already being pulled by node1 Stderr: zoo2 Skipped - Image is already being pulled by node1 Stderr: zoo2 Skipped - Image is already being pulled by node1 Stderr: zoo3 Skipped - Image is already being pulled by node1 Stderr: zoo3 Skipped - Image is already being pulled by node1 Stderr: resolver Pulling Stderr: resolver Pulling Stderr: minio1 Pulling Stderr: minio1 Pulling Stderr: proxy1 Pulling Stderr: proxy1 Pulling Stderr: node1 Pulling Stderr: node1 Pulling Stderr: minio1 Pulled Stderr: minio1 Pulled Stderr: node1 Pulled Stderr: node1 Pulled Stderr: proxy1 Pulled Stderr: proxy1 Pulled Stderr: resolver Pulled Stderr: resolver Pulled Setup ZooKeeper Setup ZooKeeper Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper1/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper1/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper1/coordination', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper2/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper2/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper2/coordination', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper3/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper3/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper3/coordination'] Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper1/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper1/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper1/coordination', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper2/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper2/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper2/coordination', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper3/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper3/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper3/coordination'] Command:[docker compose --project-name roottestreplicatedmergetreereplicateddbttl-gw3 --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Command:[docker compose --project-name roottestreplicatedmergetreereplicateddbttl-gw3 --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: minio1 Pulling Stderr: minio1 Pulling Stderr: resolver Pulling Stderr: resolver Pulling Stderr: proxy1 Pulling Stderr: proxy1 Pulling Stderr: node Pulling Stderr: node Pulling Stderr: node Pulled Stderr: node Pulled Stderr: proxy1 Pulled Stderr: proxy1 Pulled Stderr: minio1 Pulled Stderr: minio1 Pulled Stderr: resolver Pulled Stderr: resolver Pulled Trying to create Minio instance by command docker compose --project-name roottests3storageconfnewproxy-gw6 --env-file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Trying to create Minio instance by command docker compose --project-name roottests3storageconfnewproxy-gw6 --env-file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Command:[docker compose --project-name roottests3storageconfnewproxy-gw6 --env-file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Command:[docker compose --project-name roottests3storageconfnewproxy-gw6 --env-file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Stderr:time="2025-04-02T02:56:18Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:56:18Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottestreplicatedmergetreereplicateddbttl-gw3_default Creating Stderr: Network roottestreplicatedmergetreereplicateddbttl-gw3_default Creating Stderr: Network roottestreplicatedmergetreereplicateddbttl-gw3_default Created Stderr: Network roottestreplicatedmergetreereplicateddbttl-gw3_default Created Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 Creating Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 Creating Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 Creating Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 Creating Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 Creating Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 Creating Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 Created Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 Created Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 Created Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 Created Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 Created Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 Created Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 Starting Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 Starting Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 Starting Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 Starting Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 Starting Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 Starting Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 Started Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 Started Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 Started Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 Started Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 Started Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 Started Stderr:time="2025-04-02T02:56:19Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:56:19Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:56:19Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:56:19Z" level=debug msg="otel error" error="" Wait ZooKeeper to start Wait ZooKeeper to start get_instance_ip instance_name=zoo1 get_instance_ip instance_name=zoo1 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1/json HTTP/1.1" 200 None get_kazoo_client: zoo1, ip:172.16.2.4, port:2181, use_ssl:False get_kazoo_client: zoo1, ip:172.16.2.4, port:2181, use_ssl:False Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Stderr:time="2025-04-02T02:56:18Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:56:18Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottests3storageconfnewproxy-gw6_default Creating Stderr: Network roottests3storageconfnewproxy-gw6_default Creating Stderr: Network roottests3storageconfnewproxy-gw6_default Created Stderr: Network roottests3storageconfnewproxy-gw6_default Created Stderr: Volume "roottests3storageconfnewproxy-gw6_data1-1" Creating Stderr: Volume "roottests3storageconfnewproxy-gw6_data1-1" Creating Stderr: Volume "roottests3storageconfnewproxy-gw6_data1-1" Created Stderr: Volume "roottests3storageconfnewproxy-gw6_data1-1" Created Stderr: Container roottests3storageconfnewproxy-gw6-proxy2-1 Creating Stderr: Container roottests3storageconfnewproxy-gw6-proxy2-1 Creating Stderr: Container roottests3storageconfnewproxy-gw6-proxy1-1 Creating Stderr: Container roottests3storageconfnewproxy-gw6-proxy1-1 Creating Stderr: Container roottests3storageconfnewproxy-gw6-proxy2-1 Created Stderr: Container roottests3storageconfnewproxy-gw6-proxy2-1 Created Stderr: Container roottests3storageconfnewproxy-gw6-proxy1-1 Created Stderr: Container roottests3storageconfnewproxy-gw6-proxy1-1 Created Stderr: Container roottests3storageconfnewproxy-gw6-minio1-1 Creating Stderr: Container roottests3storageconfnewproxy-gw6-minio1-1 Creating Stderr: Container roottests3storageconfnewproxy-gw6-resolver-1 Creating Stderr: Container roottests3storageconfnewproxy-gw6-resolver-1 Creating Stderr: Container roottests3storageconfnewproxy-gw6-resolver-1 Created Stderr: Container roottests3storageconfnewproxy-gw6-resolver-1 Created Stderr: Container roottests3storageconfnewproxy-gw6-minio1-1 Created Stderr: Container roottests3storageconfnewproxy-gw6-minio1-1 Created Stderr: Container roottests3storageconfnewproxy-gw6-proxy2-1 Starting Stderr: Container roottests3storageconfnewproxy-gw6-proxy2-1 Starting Stderr: Container roottests3storageconfnewproxy-gw6-proxy1-1 Starting Stderr: Container roottests3storageconfnewproxy-gw6-proxy1-1 Starting Stderr: Container roottests3storageconfnewproxy-gw6-proxy1-1 Started Stderr: Container roottests3storageconfnewproxy-gw6-proxy1-1 Started Stderr: Container roottests3storageconfnewproxy-gw6-proxy2-1 Started Stderr: Container roottests3storageconfnewproxy-gw6-proxy2-1 Started Stderr: Container roottests3storageconfnewproxy-gw6-minio1-1 Starting Stderr: Container roottests3storageconfnewproxy-gw6-minio1-1 Starting Stderr: Container roottests3storageconfnewproxy-gw6-resolver-1 Starting Stderr: Container roottests3storageconfnewproxy-gw6-resolver-1 Starting Stderr: Container roottests3storageconfnewproxy-gw6-resolver-1 Started Stderr: Container roottests3storageconfnewproxy-gw6-resolver-1 Started Stderr: Container roottests3storageconfnewproxy-gw6-minio1-1 Started Stderr: Container roottests3storageconfnewproxy-gw6-minio1-1 Started Stderr:time="2025-04-02T02:56:19Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:56:19Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:56:19Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:56:19Z" level=debug msg="otel error" error="" Trying to connect to Minio... Trying to connect to Minio... get_instance_ip instance_name=minio1 get_instance_ip instance_name=minio1 http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-minio1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-minio1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=proxy1 get_instance_ip instance_name=proxy1 http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None Starting new HTTP connection (1): 172.16.5.4:9001 Starting new HTTP connection (1): 172.16.5.4:9001 Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (2): 172.16.5.4:9001 Starting new HTTP connection (2): 172.16.5.4:9001 Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (3): 172.16.5.4:9001 Starting new HTTP connection (3): 172.16.5.4:9001 Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (4): 172.16.5.4:9001 Starting new HTTP connection (4): 172.16.5.4:9001 Can't connect to Minio: HTTPConnectionPool(host='172.16.5.4', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Can't connect to Minio: HTTPConnectionPool(host='172.16.5.4', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Starting new HTTP connection (5): 172.16.5.4:9001 Starting new HTTP connection (5): 172.16.5.4:9001 http://172.16.5.4:9001 "GET / HTTP/1.1" 200 0 http://172.16.5.4:9001 "GET / HTTP/1.1" 200 0 Connected to Minio. Connected to Minio. http://172.16.5.4:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.5.4:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.5.4:9001 "PUT /root HTTP/1.1" 200 0 http://172.16.5.4:9001 "PUT /root HTTP/1.1" 200 0 S3 bucket 'root' created S3 bucket 'root' created http://172.16.5.4:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.5.4:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.5.4:9001 "PUT /root2 HTTP/1.1" 200 0 http://172.16.5.4:9001 "PUT /root2 HTTP/1.1" 200 0 S3 bucket 'root2' created S3 bucket 'root2' created ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/.env --project-name roottests3storageconfnewproxy-gw6 --file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/.env --project-name roottests3storageconfnewproxy-gw6 --file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/.env --project-name roottests3storageconfnewproxy-gw6 --file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/.env --project-name roottests3storageconfnewproxy-gw6 --file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate] Stderr: Container roottests3storageconfnewproxy-gw6-proxy2-1 Running Stderr: Container roottests3storageconfnewproxy-gw6-proxy2-1 Running Stderr: Container roottests3storageconfnewproxy-gw6-proxy1-1 Running Stderr: Container roottests3storageconfnewproxy-gw6-proxy1-1 Running Stderr: Container roottests3storageconfnewproxy-gw6-resolver-1 Running Stderr: Container roottests3storageconfnewproxy-gw6-resolver-1 Running Stderr: Container roottests3storageconfnewproxy-gw6-minio1-1 Running Stderr: Container roottests3storageconfnewproxy-gw6-minio1-1 Running Stderr: Container roottests3storageconfnewproxy-gw6-node-1 Creating Stderr: Container roottests3storageconfnewproxy-gw6-node-1 Creating Stderr: Container roottests3storageconfnewproxy-gw6-node-1 Created Stderr: Container roottests3storageconfnewproxy-gw6-node-1 Created Stderr: Container roottests3storageconfnewproxy-gw6-node-1 Starting Stderr: Container roottests3storageconfnewproxy-gw6-node-1 Starting Stderr: Container roottests3storageconfnewproxy-gw6-node-1 Started Stderr: Container roottests3storageconfnewproxy-gw6-node-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-node-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-node-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node, ip: 172.16.5.6... Waiting for ClickHouse start in node, ip: 172.16.5.6... http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/af340735bff8191d0291ebb7ab12d0615ce6f03cd4c9d4b65ec01c7e64468064/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/af340735bff8191d0291ebb7ab12d0615ce6f03cd4c9d4b65ec01c7e64468064/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/af340735bff8191d0291ebb7ab12d0615ce6f03cd4c9d4b65ec01c7e64468064/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/af340735bff8191d0291ebb7ab12d0615ce6f03cd4c9d4b65ec01c7e64468064/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/af340735bff8191d0291ebb7ab12d0615ce6f03cd4c9d4b65ec01c7e64468064/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/af340735bff8191d0291ebb7ab12d0615ce6f03cd4c9d4b65ec01c7e64468064/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/af340735bff8191d0291ebb7ab12d0615ce6f03cd4c9d4b65ec01c7e64468064/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/af340735bff8191d0291ebb7ab12d0615ce6f03cd4c9d4b65ec01c7e64468064/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/af340735bff8191d0291ebb7ab12d0615ce6f03cd4c9d4b65ec01c7e64468064/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/af340735bff8191d0291ebb7ab12d0615ce6f03cd4c9d4b65ec01c7e64468064/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/af340735bff8191d0291ebb7ab12d0615ce6f03cd4c9d4b65ec01c7e64468064/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/af340735bff8191d0291ebb7ab12d0615ce6f03cd4c9d4b65ec01c7e64468064/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/af340735bff8191d0291ebb7ab12d0615ce6f03cd4c9d4b65ec01c7e64468064/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/af340735bff8191d0291ebb7ab12d0615ce6f03cd4c9d4b65ec01c7e64468064/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/af340735bff8191d0291ebb7ab12d0615ce6f03cd4c9d4b65ec01c7e64468064/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/af340735bff8191d0291ebb7ab12d0615ce6f03cd4c9d4b65ec01c7e64468064/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/af340735bff8191d0291ebb7ab12d0615ce6f03cd4c9d4b65ec01c7e64468064/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/af340735bff8191d0291ebb7ab12d0615ce6f03cd4c9d4b65ec01c7e64468064/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/af340735bff8191d0291ebb7ab12d0615ce6f03cd4c9d4b65ec01c7e64468064/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/af340735bff8191d0291ebb7ab12d0615ce6f03cd4c9d4b65ec01c7e64468064/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/af340735bff8191d0291ebb7ab12d0615ce6f03cd4c9d4b65ec01c7e64468064/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/af340735bff8191d0291ebb7ab12d0615ce6f03cd4c9d4b65ec01c7e64468064/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/af340735bff8191d0291ebb7ab12d0615ce6f03cd4c9d4b65ec01c7e64468064/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/af340735bff8191d0291ebb7ab12d0615ce6f03cd4c9d4b65ec01c7e64468064/json HTTP/1.1" 200 None Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost http://localhost:None "GET /v1.46/containers/af340735bff8191d0291ebb7ab12d0615ce6f03cd4c9d4b65ec01c7e64468064/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/af340735bff8191d0291ebb7ab12d0615ce6f03cd4c9d4b65ec01c7e64468064/json HTTP/1.1" 200 None Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo2 get_instance_ip instance_name=zoo2 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1/json HTTP/1.1" 200 None get_kazoo_client: zoo2, ip:172.16.2.3, port:2181, use_ssl:False get_kazoo_client: zoo2, ip:172.16.2.3, port:2181, use_ssl:False Connecting to 172.16.2.3(172.16.2.3):2181, use_ssl: False Connecting to 172.16.2.3(172.16.2.3):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() http://localhost:None "GET /v1.46/containers/af340735bff8191d0291ebb7ab12d0615ce6f03cd4c9d4b65ec01c7e64468064/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/af340735bff8191d0291ebb7ab12d0615ce6f03cd4c9d4b65ec01c7e64468064/json HTTP/1.1" 200 None ClickHouse node started ClickHouse node started Cluster started Cluster started Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Executing query CREATE TABLE s3_test ( id Int64, data String ) ENGINE=MergeTree() ORDER BY id SETTINGS storage_policy='s3' on node Executing query CREATE TABLE s3_test ( id Int64, data String ) ENGINE=MergeTree() ORDER BY id SETTINGS storage_policy='s3' on node Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo3 get_instance_ip instance_name=zoo3 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1/json HTTP/1.1" 200 None get_kazoo_client: zoo3, ip:172.16.2.2, port:2181, use_ssl:False get_kazoo_client: zoo3, ip:172.16.2.2, port:2181, use_ssl:False Connecting to 172.16.2.2(172.16.2.2):2181, use_ssl: False Connecting to 172.16.2.2(172.16.2.2):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') Trying to create Minio instance by command docker compose --project-name roottestreplicatedmergetreereplicateddbttl-gw3 --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Trying to create Minio instance by command docker compose --project-name roottestreplicatedmergetreereplicateddbttl-gw3 --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Command:[docker compose --project-name roottestreplicatedmergetreereplicateddbttl-gw3 --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Command:[docker compose --project-name roottestreplicatedmergetreereplicateddbttl-gw3 --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Executing query INSERT INTO s3_test VALUES (0,'data'),(1,'data') on node Executing query INSERT INTO s3_test VALUES (0,'data'),(1,'data') on node Executing query SELECT * FROM s3_test order by id FORMAT Values on node Executing query SELECT * FROM s3_test order by id FORMAT Values on node Connection dropped: outstanding heartbeat ping not received Connection dropped: outstanding heartbeat ping not received Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Executing query DROP TABLE IF EXISTS s3_test SYNC on node Executing query DROP TABLE IF EXISTS s3_test SYNC on node Connecting to 172.16.6.4(172.16.6.4):2181, use_ssl: False Connecting to 172.16.6.4(172.16.6.4):2181, use_ssl: False Stderr:time="2025-04-02T02:56:22Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:56:22Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Volume "roottestreplicatedmergetreereplicateddbttl-gw3_data1-1" Creating Stderr: Volume "roottestreplicatedmergetreereplicateddbttl-gw3_data1-1" Creating Stderr: Volume "roottestreplicatedmergetreereplicateddbttl-gw3_data1-1" Created Stderr: Volume "roottestreplicatedmergetreereplicateddbttl-gw3_data1-1" Created Stderr:time="2025-04-02T02:56:22Z" level=warning msg="Found orphan containers ([roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1]) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up." Stderr:time="2025-04-02T02:56:22Z" level=warning msg="Found orphan containers ([roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1]) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up." Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy2-1 Creating Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy2-1 Creating Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1 Creating Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1 Creating Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy2-1 Created Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy2-1 Created Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1 Created Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1 Created Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1 Creating Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1 Creating Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-resolver-1 Creating Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-resolver-1 Creating Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-resolver-1 Created Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-resolver-1 Created Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1 Created Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1 Created Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy2-1 Starting Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy2-1 Starting Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1 Starting Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1 Starting Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1 Started Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1 Started Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy2-1 Started Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy2-1 Started Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1 Starting Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1 Starting Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-resolver-1 Starting Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-resolver-1 Starting Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1 Started Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1 Started Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-resolver-1 Started Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-resolver-1 Started Stderr:time="2025-04-02T02:56:23Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:56:23Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:56:23Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:56:23Z" level=debug msg="otel error" error="" Trying to connect to Minio... Trying to connect to Minio... get_instance_ip instance_name=minio1 get_instance_ip instance_name=minio1 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=proxy1 get_instance_ip instance_name=proxy1 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1/json HTTP/1.1" 200 None Starting new HTTP connection (1): 172.16.2.7:9001 Starting new HTTP connection (1): 172.16.2.7:9001 Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (2): 172.16.2.7:9001 Starting new HTTP connection (2): 172.16.2.7:9001 Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (3): 172.16.2.7:9001 Starting new HTTP connection (3): 172.16.2.7:9001 Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (4): 172.16.2.7:9001 Starting new HTTP connection (4): 172.16.2.7:9001 Can't connect to Minio: HTTPConnectionPool(host='172.16.2.7', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Can't connect to Minio: HTTPConnectionPool(host='172.16.2.7', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None Starting new HTTP connection (5): 172.16.2.7:9001 Starting new HTTP connection (5): 172.16.2.7:9001 http://172.16.2.7:9001 "GET / HTTP/1.1" 200 0 http://172.16.2.7:9001 "GET / HTTP/1.1" 200 0 Connected to Minio. Connected to Minio. http://172.16.2.7:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.2.7:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.2.7:9001 "PUT /root HTTP/1.1" 200 0 http://172.16.2.7:9001 "PUT /root HTTP/1.1" 200 0 S3 bucket 'root' created S3 bucket 'root' created http://172.16.2.7:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.2.7:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.2.7:9001 "PUT /root2 HTTP/1.1" 200 0 http://172.16.2.7:9001 "PUT /root2 HTTP/1.1" 200 0 S3 bucket 'root2' created S3 bucket 'root2' created ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/.env --project-name roottestreplicatedmergetreereplicateddbttl-gw3 --file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/.env --project-name roottestreplicatedmergetreereplicateddbttl-gw3 --file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/.env --project-name roottestreplicatedmergetreereplicateddbttl-gw3 --file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/.env --project-name roottestreplicatedmergetreereplicateddbttl-gw3 --file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate] http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 Running Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 Running Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy2-1 Running Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy2-1 Running Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 Running Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 Running Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 Running Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 Running Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1 Running Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1 Running Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-resolver-1 Running Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-resolver-1 Running Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1 Running Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1 Running Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-node1-1 Creating Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-node1-1 Creating Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-node1-1 Created Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-node1-1 Created Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-node1-1 Starting Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-node1-1 Starting Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-node1-1 Started Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-node1-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node1 get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreereplicateddbttl-gw3-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreereplicateddbttl-gw3-node1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node1 get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreereplicateddbttl-gw3-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreereplicateddbttl-gw3-node1-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node1, ip: 172.16.2.9... Waiting for ClickHouse start in node1, ip: 172.16.2.9... http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreereplicateddbttl-gw3-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreereplicateddbttl-gw3-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ca71e3323edcadce413a91bc034bbc96ce84c067465b4c4cda7fb76b39989bca/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ca71e3323edcadce413a91bc034bbc96ce84c067465b4c4cda7fb76b39989bca/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ca71e3323edcadce413a91bc034bbc96ce84c067465b4c4cda7fb76b39989bca/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ca71e3323edcadce413a91bc034bbc96ce84c067465b4c4cda7fb76b39989bca/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ca71e3323edcadce413a91bc034bbc96ce84c067465b4c4cda7fb76b39989bca/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ca71e3323edcadce413a91bc034bbc96ce84c067465b4c4cda7fb76b39989bca/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ca71e3323edcadce413a91bc034bbc96ce84c067465b4c4cda7fb76b39989bca/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ca71e3323edcadce413a91bc034bbc96ce84c067465b4c4cda7fb76b39989bca/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ca71e3323edcadce413a91bc034bbc96ce84c067465b4c4cda7fb76b39989bca/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ca71e3323edcadce413a91bc034bbc96ce84c067465b4c4cda7fb76b39989bca/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ca71e3323edcadce413a91bc034bbc96ce84c067465b4c4cda7fb76b39989bca/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ca71e3323edcadce413a91bc034bbc96ce84c067465b4c4cda7fb76b39989bca/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ca71e3323edcadce413a91bc034bbc96ce84c067465b4c4cda7fb76b39989bca/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ca71e3323edcadce413a91bc034bbc96ce84c067465b4c4cda7fb76b39989bca/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ca71e3323edcadce413a91bc034bbc96ce84c067465b4c4cda7fb76b39989bca/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ca71e3323edcadce413a91bc034bbc96ce84c067465b4c4cda7fb76b39989bca/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ca71e3323edcadce413a91bc034bbc96ce84c067465b4c4cda7fb76b39989bca/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ca71e3323edcadce413a91bc034bbc96ce84c067465b4c4cda7fb76b39989bca/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ca71e3323edcadce413a91bc034bbc96ce84c067465b4c4cda7fb76b39989bca/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ca71e3323edcadce413a91bc034bbc96ce84c067465b4c4cda7fb76b39989bca/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ca71e3323edcadce413a91bc034bbc96ce84c067465b4c4cda7fb76b39989bca/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ca71e3323edcadce413a91bc034bbc96ce84c067465b4c4cda7fb76b39989bca/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ca71e3323edcadce413a91bc034bbc96ce84c067465b4c4cda7fb76b39989bca/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ca71e3323edcadce413a91bc034bbc96ce84c067465b4c4cda7fb76b39989bca/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ca71e3323edcadce413a91bc034bbc96ce84c067465b4c4cda7fb76b39989bca/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ca71e3323edcadce413a91bc034bbc96ce84c067465b4c4cda7fb76b39989bca/json HTTP/1.1" 200 None [gw8] PASSED test_reload_client_certificate/test.py::test_wrong_cn_cert Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --project-name roottestreloadclientcertificate-gw8 --file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml --file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/node2/docker-compose.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --project-name roottestreloadclientcertificate-gw8 --file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml --file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/node2/docker-compose.yml stop --timeout 20] http://localhost:None "GET /v1.46/containers/ca71e3323edcadce413a91bc034bbc96ce84c067465b4c4cda7fb76b39989bca/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/ca71e3323edcadce413a91bc034bbc96ce84c067465b4c4cda7fb76b39989bca/json HTTP/1.1" 200 None ClickHouse node1 started ClickHouse node1 started Executing query DROP DATABASE default on node1 Executing query DROP DATABASE default on node1 Executing query CREATE DATABASE default ENGINE Replicated('/replicated') on node1 Executing query CREATE DATABASE default ENGINE Replicated('/replicated') on node1 http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None Executing query CREATE TABLE 02908_main (a UInt32) ENGINE = ReplicatedMergeTree ORDER BY a on node1 Executing query CREATE TABLE 02908_main (a UInt32) ENGINE = ReplicatedMergeTree ORDER BY a on node1 Executing query CREATE TABLE 02908_dependent (a UInt32, ts DateTime) ENGINE = ReplicatedMergeTree ORDER BY a TTL ts + 1 WHERE a IN (SELECT a FROM 02908_main) on node1 Executing query CREATE TABLE 02908_dependent (a UInt32, ts DateTime) ENGINE = ReplicatedMergeTree ORDER BY a TTL ts + 1 WHERE a IN (SELECT a FROM 02908_main) on node1 Stderr: Container roottestreplicatedparsezkmetadata-gw5-node-1 Stopping Stderr: Container roottestreplicatedparsezkmetadata-gw5-node-1 Stopping Stderr: Container roottestreplicatedparsezkmetadata-gw5-node-1 Stopped Stderr: Container roottestreplicatedparsezkmetadata-gw5-node-1 Stopped Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo2-1 Stopping Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo2-1 Stopping Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo1-1 Stopping Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo1-1 Stopping Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo3-1 Stopping Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo3-1 Stopping Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo2-1 Stopped Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo2-1 Stopped Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo3-1 Stopped Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo3-1 Stopped Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo1-1 Stopped Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo1-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/.env --project-name roottestreplicatedparsezkmetadata-gw5 --file /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/.env --project-name roottestreplicatedparsezkmetadata-gw5 --file /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw5/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml down --volumes] Connection dropped: socket connection error: No route to host Connection dropped: socket connection error: No route to host Connecting to 172.16.6.4(172.16.6.4):2181, use_ssl: False Connecting to 172.16.6.4(172.16.6.4):2181, use_ssl: False Executing query INSERT INTO 02908_main VALUES (1) on node1 Executing query INSERT INTO 02908_main VALUES (1) on node1 http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None Stderr: Container roottests3storageclass-gw4-node-1 Stopping Stderr: Container roottests3storageclass-gw4-node-1 Stopping Stderr: Container roottests3storageclass-gw4-resolver-1 Stopping Stderr: Container roottests3storageclass-gw4-resolver-1 Stopping Stderr: Container roottests3storageclass-gw4-node-1 Stopped Stderr: Container roottests3storageclass-gw4-node-1 Stopped Stderr: Container roottests3storageclass-gw4-minio1-1 Stopping Stderr: Container roottests3storageclass-gw4-minio1-1 Stopping Stderr: Container roottests3storageclass-gw4-minio1-1 Stopped Stderr: Container roottests3storageclass-gw4-minio1-1 Stopped Stderr: Container roottests3storageclass-gw4-resolver-1 Stopped Stderr: Container roottests3storageclass-gw4-resolver-1 Stopped Stderr: Container roottests3storageclass-gw4-proxy1-1 Stopping Stderr: Container roottests3storageclass-gw4-proxy1-1 Stopping Stderr: Container roottests3storageclass-gw4-proxy2-1 Stopping Stderr: Container roottests3storageclass-gw4-proxy2-1 Stopping Stderr: Container roottests3storageclass-gw4-proxy1-1 Stopped Stderr: Container roottests3storageclass-gw4-proxy1-1 Stopped Stderr: Container roottests3storageclass-gw4-proxy2-1 Stopped Stderr: Container roottests3storageclass-gw4-proxy2-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw4/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw4/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw4/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw4/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw4/.env --project-name roottests3storageclass-gw4 --file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw4/.env --project-name roottests3storageclass-gw4 --file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml down --volumes] Executing query INSERT INTO 02908_dependent VALUES (1, now()) on node1 Executing query INSERT INTO 02908_dependent VALUES (1, now()) on node1 Stderr: Container roottestreplicatedparsezkmetadata-gw5-node-1 Stopping Stderr: Container roottestreplicatedparsezkmetadata-gw5-node-1 Stopping Stderr: Container roottestreplicatedparsezkmetadata-gw5-node-1 Stopped Stderr: Container roottestreplicatedparsezkmetadata-gw5-node-1 Stopped Stderr: Container roottestreplicatedparsezkmetadata-gw5-node-1 Removing Stderr: Container roottestreplicatedparsezkmetadata-gw5-node-1 Removing Stderr: Container roottestreplicatedparsezkmetadata-gw5-node-1 Removed Stderr: Container roottestreplicatedparsezkmetadata-gw5-node-1 Removed Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo2-1 Stopping Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo2-1 Stopping Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo3-1 Stopping Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo3-1 Stopping Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo1-1 Stopping Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo1-1 Stopping Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo3-1 Stopped Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo3-1 Stopped Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo3-1 Removing Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo3-1 Removing Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo2-1 Stopped Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo2-1 Stopped Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo2-1 Removing Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo2-1 Removing Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo1-1 Stopped Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo1-1 Stopped Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo1-1 Removing Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo1-1 Removing Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo3-1 Removed Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo3-1 Removed Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo2-1 Removed Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo2-1 Removed Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo1-1 Removed Stderr: Container roottestreplicatedparsezkmetadata-gw5-zoo1-1 Removed Stderr: Network roottestreplicatedparsezkmetadata-gw5_default Removing Stderr: Network roottestreplicatedparsezkmetadata-gw5_default Removing Stderr: Network roottestreplicatedparsezkmetadata-gw5_default Removed Stderr: Network roottestreplicatedparsezkmetadata-gw5_default Removed Cleanup called Cleanup called Docker networks for project roottestreplicatedparsezkmetadata-gw5 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicatedparsezkmetadata-gw5 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestreplicatedparsezkmetadata-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicatedparsezkmetadata-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreplicatedparsezkmetadata-gw5 are DRIVER VOLUME NAME Docker volumes for project roottestreplicatedparsezkmetadata-gw5 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestreplicatedparsezkmetadata-gw5-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestreplicatedparsezkmetadata-gw5-.*-1$' --format '{{.ID}}:{{.Names}}'] Executing query SELECT * FROM 02908_dependent on node1 Executing query SELECT * FROM 02908_dependent on node1 Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestreplicatedparsezkmetadata-gw5 No running containers for project: roottestreplicatedparsezkmetadata-gw5 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:10 Stdout:10 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 10 Volumes pruned: 10 Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/.env --project-name roottestreplicatedmergetreereplicateddbttl-gw3 --file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/.env --project-name roottestreplicatedmergetreereplicateddbttl-gw3 --file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml stop --timeout 20] [gw3] PASSED test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl Stderr: Container roottests3storageclass-gw4-resolver-1 Stopping Stderr: Container roottests3storageclass-gw4-resolver-1 Stopping Stderr: Container roottests3storageclass-gw4-node-1 Stopping Stderr: Container roottests3storageclass-gw4-node-1 Stopping Stderr: Container roottests3storageclass-gw4-resolver-1 Stopped Stderr: Container roottests3storageclass-gw4-resolver-1 Stopped Stderr: Container roottests3storageclass-gw4-resolver-1 Removing Stderr: Container roottests3storageclass-gw4-resolver-1 Removing Stderr: Container roottests3storageclass-gw4-node-1 Stopped Stderr: Container roottests3storageclass-gw4-node-1 Stopped Stderr: Container roottests3storageclass-gw4-node-1 Removing Stderr: Container roottests3storageclass-gw4-node-1 Removing Stderr: Container roottests3storageclass-gw4-resolver-1 Removed Stderr: Container roottests3storageclass-gw4-resolver-1 Removed Stderr: Container roottests3storageclass-gw4-node-1 Removed Stderr: Container roottests3storageclass-gw4-node-1 Removed Stderr: Container roottests3storageclass-gw4-minio1-1 Stopping Stderr: Container roottests3storageclass-gw4-minio1-1 Stopping Stderr: Container roottests3storageclass-gw4-minio1-1 Stopped Stderr: Container roottests3storageclass-gw4-minio1-1 Stopped Stderr: Container roottests3storageclass-gw4-minio1-1 Removing Stderr: Container roottests3storageclass-gw4-minio1-1 Removing Stderr: Container roottests3storageclass-gw4-minio1-1 Removed Stderr: Container roottests3storageclass-gw4-minio1-1 Removed Stderr: Container roottests3storageclass-gw4-proxy1-1 Stopping Stderr: Container roottests3storageclass-gw4-proxy1-1 Stopping Stderr: Container roottests3storageclass-gw4-proxy2-1 Stopping Stderr: Container roottests3storageclass-gw4-proxy2-1 Stopping Stderr: Container roottests3storageclass-gw4-proxy1-1 Stopped Stderr: Container roottests3storageclass-gw4-proxy1-1 Stopped Stderr: Container roottests3storageclass-gw4-proxy1-1 Removing Stderr: Container roottests3storageclass-gw4-proxy1-1 Removing Stderr: Container roottests3storageclass-gw4-proxy2-1 Stopped Stderr: Container roottests3storageclass-gw4-proxy2-1 Stopped Stderr: Container roottests3storageclass-gw4-proxy2-1 Removing Stderr: Container roottests3storageclass-gw4-proxy2-1 Removing Stderr: Container roottests3storageclass-gw4-proxy1-1 Removed Stderr: Container roottests3storageclass-gw4-proxy1-1 Removed Stderr: Container roottests3storageclass-gw4-proxy2-1 Removed Stderr: Container roottests3storageclass-gw4-proxy2-1 Removed Stderr: Volume roottests3storageclass-gw4_data1-1 Removing Stderr: Volume roottests3storageclass-gw4_data1-1 Removing Stderr: Network roottests3storageclass-gw4_default Removing Stderr: Network roottests3storageclass-gw4_default Removing Stderr: Volume roottests3storageclass-gw4_data1-1 Removed Stderr: Volume roottests3storageclass-gw4_data1-1 Removed Stderr: Network roottests3storageclass-gw4_default Removed Stderr: Network roottests3storageclass-gw4_default Removed Cleanup called Cleanup called Docker networks for project roottests3storageclass-gw4 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3storageclass-gw4 are NETWORK ID NAME DRIVER SCOPE Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Docker containers for project roottests3storageclass-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3storageclass-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3storageclass-gw4 are DRIVER VOLUME NAME Docker volumes for project roottests3storageclass-gw4 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottests3storageclass-gw4-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottests3storageclass-gw4-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottests3storageclass-gw4 No running containers for project: roottests3storageclass-gw4 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:10 Stdout:10 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 10 Volumes pruned: 10 http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw6-proxy1-1/json HTTP/1.1" 200 None Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/.env --project-name roottests3storageconfnewproxy-gw6 --file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/.env --project-name roottests3storageconfnewproxy-gw6 --file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml stop --timeout 20] [gw6] PASSED test_s3_storage_conf_new_proxy/test.py::test_s3_with_proxy_list[s3] Stderr: Container roottestremovestalemovingparts-gw9-ch1-1 Stopping Stderr: Container roottestremovestalemovingparts-gw9-ch1-1 Stopping Stderr: Container roottestremovestalemovingparts-gw9-resolver-1 Stopping Stderr: Container roottestremovestalemovingparts-gw9-resolver-1 Stopping Stderr: Container roottestremovestalemovingparts-gw9-ch1-1 Stopped Stderr: Container roottestremovestalemovingparts-gw9-ch1-1 Stopped Stderr: Container roottestremovestalemovingparts-gw9-zoo3-1 Stopping Stderr: Container roottestremovestalemovingparts-gw9-zoo3-1 Stopping Stderr: Container roottestremovestalemovingparts-gw9-zoo1-1 Stopping Stderr: Container roottestremovestalemovingparts-gw9-zoo1-1 Stopping Stderr: Container roottestremovestalemovingparts-gw9-zoo2-1 Stopping Stderr: Container roottestremovestalemovingparts-gw9-zoo2-1 Stopping Stderr: Container roottestremovestalemovingparts-gw9-minio1-1 Stopping Stderr: Container roottestremovestalemovingparts-gw9-minio1-1 Stopping Stderr: Container roottestremovestalemovingparts-gw9-minio1-1 Stopped Stderr: Container roottestremovestalemovingparts-gw9-minio1-1 Stopped Stderr: Container roottestremovestalemovingparts-gw9-zoo1-1 Stopped Stderr: Container roottestremovestalemovingparts-gw9-zoo1-1 Stopped Stderr: Container roottestremovestalemovingparts-gw9-zoo3-1 Stopped Stderr: Container roottestremovestalemovingparts-gw9-zoo3-1 Stopped Stderr: Container roottestremovestalemovingparts-gw9-zoo2-1 Stopped Stderr: Container roottestremovestalemovingparts-gw9-zoo2-1 Stopped Stderr: Container roottestremovestalemovingparts-gw9-resolver-1 Stopped Stderr: Container roottestremovestalemovingparts-gw9-resolver-1 Stopped Stderr: Container roottestremovestalemovingparts-gw9-proxy1-1 Stopping Stderr: Container roottestremovestalemovingparts-gw9-proxy1-1 Stopping Stderr: Container roottestremovestalemovingparts-gw9-proxy2-1 Stopping Stderr: Container roottestremovestalemovingparts-gw9-proxy2-1 Stopping Stderr: Container roottestremovestalemovingparts-gw9-proxy2-1 Stopped Stderr: Container roottestremovestalemovingparts-gw9-proxy2-1 Stopped Stderr: Container roottestremovestalemovingparts-gw9-proxy1-1 Stopped Stderr: Container roottestremovestalemovingparts-gw9-proxy1-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/ch1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/ch1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/ch1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/ch1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/.env --project-name roottestremovestalemovingparts-gw9 --file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/ch1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/.env --project-name roottestremovestalemovingparts-gw9 --file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw9/ch1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml down --volumes] Stderr: Container roottestremovestalemovingparts-gw9-ch1-1 Stopping Stderr: Container roottestremovestalemovingparts-gw9-ch1-1 Stopping Stderr: Container roottestremovestalemovingparts-gw9-resolver-1 Stopping Stderr: Container roottestremovestalemovingparts-gw9-resolver-1 Stopping Stderr: Container roottestremovestalemovingparts-gw9-ch1-1 Stopped Stderr: Container roottestremovestalemovingparts-gw9-ch1-1 Stopped Stderr: Container roottestremovestalemovingparts-gw9-ch1-1 Removing Stderr: Container roottestremovestalemovingparts-gw9-ch1-1 Removing Stderr: Container roottestremovestalemovingparts-gw9-resolver-1 Stopped Stderr: Container roottestremovestalemovingparts-gw9-resolver-1 Stopped Stderr: Container roottestremovestalemovingparts-gw9-resolver-1 Removing Stderr: Container roottestremovestalemovingparts-gw9-resolver-1 Removing Stderr: Container roottestremovestalemovingparts-gw9-ch1-1 Removed Stderr: Container roottestremovestalemovingparts-gw9-ch1-1 Removed Stderr: Container roottestremovestalemovingparts-gw9-zoo1-1 Stopping Stderr: Container roottestremovestalemovingparts-gw9-zoo1-1 Stopping Stderr: Container roottestremovestalemovingparts-gw9-zoo2-1 Stopping Stderr: Container roottestremovestalemovingparts-gw9-zoo2-1 Stopping Stderr: Container roottestremovestalemovingparts-gw9-minio1-1 Stopping Stderr: Container roottestremovestalemovingparts-gw9-minio1-1 Stopping Stderr: Container roottestremovestalemovingparts-gw9-zoo3-1 Stopping Stderr: Container roottestremovestalemovingparts-gw9-zoo3-1 Stopping Stderr: Container roottestremovestalemovingparts-gw9-zoo1-1 Stopped Stderr: Container roottestremovestalemovingparts-gw9-zoo1-1 Stopped Stderr: Container roottestremovestalemovingparts-gw9-zoo1-1 Removing Stderr: Container roottestremovestalemovingparts-gw9-zoo1-1 Removing Stderr: Container roottestremovestalemovingparts-gw9-zoo2-1 Stopped Stderr: Container roottestremovestalemovingparts-gw9-zoo2-1 Stopped Stderr: Container roottestremovestalemovingparts-gw9-zoo2-1 Removing Stderr: Container roottestremovestalemovingparts-gw9-zoo2-1 Removing Stderr: Container roottestremovestalemovingparts-gw9-minio1-1 Stopped Stderr: Container roottestremovestalemovingparts-gw9-minio1-1 Stopped Stderr: Container roottestremovestalemovingparts-gw9-minio1-1 Removing Stderr: Container roottestremovestalemovingparts-gw9-minio1-1 Removing Stderr: Container roottestremovestalemovingparts-gw9-resolver-1 Removed Stderr: Container roottestremovestalemovingparts-gw9-resolver-1 Removed Stderr: Container roottestremovestalemovingparts-gw9-zoo3-1 Stopped Stderr: Container roottestremovestalemovingparts-gw9-zoo3-1 Stopped Stderr: Container roottestremovestalemovingparts-gw9-zoo3-1 Removing Stderr: Container roottestremovestalemovingparts-gw9-zoo3-1 Removing Stderr: Container roottestremovestalemovingparts-gw9-zoo2-1 Removed Stderr: Container roottestremovestalemovingparts-gw9-zoo2-1 Removed Stderr: Container roottestremovestalemovingparts-gw9-zoo1-1 Removed Stderr: Container roottestremovestalemovingparts-gw9-zoo1-1 Removed Stderr: Container roottestremovestalemovingparts-gw9-zoo3-1 Removed Stderr: Container roottestremovestalemovingparts-gw9-zoo3-1 Removed Stderr: Container roottestremovestalemovingparts-gw9-minio1-1 Removed Stderr: Container roottestremovestalemovingparts-gw9-minio1-1 Removed Stderr: Container roottestremovestalemovingparts-gw9-proxy1-1 Stopping Stderr: Container roottestremovestalemovingparts-gw9-proxy1-1 Stopping Stderr: Container roottestremovestalemovingparts-gw9-proxy2-1 Stopping Stderr: Container roottestremovestalemovingparts-gw9-proxy2-1 Stopping Stderr: Container roottestremovestalemovingparts-gw9-proxy1-1 Stopped Stderr: Container roottestremovestalemovingparts-gw9-proxy1-1 Stopped Stderr: Container roottestremovestalemovingparts-gw9-proxy1-1 Removing Stderr: Container roottestremovestalemovingparts-gw9-proxy1-1 Removing Stderr: Container roottestremovestalemovingparts-gw9-proxy2-1 Stopped Stderr: Container roottestremovestalemovingparts-gw9-proxy2-1 Stopped Stderr: Container roottestremovestalemovingparts-gw9-proxy2-1 Removing Stderr: Container roottestremovestalemovingparts-gw9-proxy2-1 Removing Stderr: Container roottestremovestalemovingparts-gw9-proxy2-1 Removed Stderr: Container roottestremovestalemovingparts-gw9-proxy2-1 Removed Stderr: Container roottestremovestalemovingparts-gw9-proxy1-1 Removed Stderr: Container roottestremovestalemovingparts-gw9-proxy1-1 Removed Stderr: Volume roottestremovestalemovingparts-gw9_data1-1 Removing Stderr: Volume roottestremovestalemovingparts-gw9_data1-1 Removing Stderr: Network roottestremovestalemovingparts-gw9_default Removing Stderr: Network roottestremovestalemovingparts-gw9_default Removing Stderr: Volume roottestremovestalemovingparts-gw9_data1-1 Removed Stderr: Volume roottestremovestalemovingparts-gw9_data1-1 Removed Stderr: Network roottestremovestalemovingparts-gw9_default Removed Stderr: Network roottestremovestalemovingparts-gw9_default Removed Cleanup called Cleanup called Docker networks for project roottestremovestalemovingparts-gw9 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestremovestalemovingparts-gw9 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestremovestalemovingparts-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestremovestalemovingparts-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestremovestalemovingparts-gw9 are DRIVER VOLUME NAME Docker volumes for project roottestremovestalemovingparts-gw9 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestremovestalemovingparts-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestremovestalemovingparts-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestremovestalemovingparts-gw9 No running containers for project: roottestremovestalemovingparts-gw9 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:8 Stdout:8 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 8 Volumes pruned: 8 Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Stopping Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Stopping Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Stopping Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Stopping Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Stopping Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Stopping Stderr: Container roottestreloadclientcertificate-gw8-node2-1 Stopping Stderr: Container roottestreloadclientcertificate-gw8-node2-1 Stopping Stderr: Container roottestreloadclientcertificate-gw8-node1-1 Stopping Stderr: Container roottestreloadclientcertificate-gw8-node1-1 Stopping Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Stopped Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Stopped Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Stopped Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Stopped Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Stopped Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Stopped Stderr: Container roottestreloadclientcertificate-gw8-node2-1 Stopped Stderr: Container roottestreloadclientcertificate-gw8-node2-1 Stopped Stderr: Container roottestreloadclientcertificate-gw8-node1-1 Stopped Stderr: Container roottestreloadclientcertificate-gw8-node1-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/node2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/node2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/node2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/node2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --project-name roottestreloadclientcertificate-gw8 --file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml --file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/node2/docker-compose.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/.env --project-name roottestreloadclientcertificate-gw8 --file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml --file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw8/node2/docker-compose.yml down --volumes] Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Stopping Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Stopping Stderr: Container roottestreloadclientcertificate-gw8-node2-1 Stopping Stderr: Container roottestreloadclientcertificate-gw8-node2-1 Stopping Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Stopping Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Stopping Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Stopping Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Stopping Stderr: Container roottestreloadclientcertificate-gw8-node1-1 Stopping Stderr: Container roottestreloadclientcertificate-gw8-node1-1 Stopping Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Stopped Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Stopped Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Removing Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Removing Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Stopped Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Stopped Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Removing Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Removing Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Stopped Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Stopped Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Removing Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Removing Stderr: Container roottestreloadclientcertificate-gw8-node1-1 Stopped Stderr: Container roottestreloadclientcertificate-gw8-node1-1 Stopped Stderr: Container roottestreloadclientcertificate-gw8-node1-1 Removing Stderr: Container roottestreloadclientcertificate-gw8-node1-1 Removing Stderr: Container roottestreloadclientcertificate-gw8-node2-1 Stopped Stderr: Container roottestreloadclientcertificate-gw8-node2-1 Stopped Stderr: Container roottestreloadclientcertificate-gw8-node2-1 Removing Stderr: Container roottestreloadclientcertificate-gw8-node2-1 Removing Stderr: Container roottestreloadclientcertificate-gw8-node1-1 Removed Stderr: Container roottestreloadclientcertificate-gw8-node1-1 Removed Stderr: Container roottestreloadclientcertificate-gw8-node2-1 Removed Stderr: Container roottestreloadclientcertificate-gw8-node2-1 Removed Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Removed Stderr: Container roottestreloadclientcertificate-gw8-zoo3-1 Removed Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Removed Stderr: Container roottestreloadclientcertificate-gw8-zoo2-1 Removed Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Removed Stderr: Container roottestreloadclientcertificate-gw8-zoo1-1 Removed Stderr: Network roottestreloadclientcertificate-gw8_default Removing Stderr: Network roottestreloadclientcertificate-gw8_default Removing Stderr: Network roottestreloadclientcertificate-gw8_default Removed Stderr: Network roottestreloadclientcertificate-gw8_default Removed Cleanup called Cleanup called Docker networks for project roottestreloadclientcertificate-gw8 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreloadclientcertificate-gw8 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestreloadclientcertificate-gw8 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreloadclientcertificate-gw8 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreloadclientcertificate-gw8 are DRIVER VOLUME NAME Docker volumes for project roottestreloadclientcertificate-gw8 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestreloadclientcertificate-gw8-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestreloadclientcertificate-gw8-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestreloadclientcertificate-gw8 No running containers for project: roottestreloadclientcertificate-gw8 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:5 Stdout:5 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 5 Volumes pruned: 5 test_replicated_merge_tree_encrypted_disk/test.py::test_different_keys Running tests in /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/test.py Running tests in /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/test.py Cluster start called. is_up=False Cluster start called. is_up=False Docker networks for project roottestreplicatedmergetreeencrypteddisk-gw8 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicatedmergetreeencrypteddisk-gw8 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestreplicatedmergetreeencrypteddisk-gw8 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicatedmergetreeencrypteddisk-gw8 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreplicatedmergetreeencrypteddisk-gw8 are DRIVER VOLUME NAME Docker volumes for project roottestreplicatedmergetreeencrypteddisk-gw8 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker networks for project roottestreplicatedmergetreeencrypteddisk-gw8 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicatedmergetreeencrypteddisk-gw8 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestreplicatedmergetreeencrypteddisk-gw8 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicatedmergetreeencrypteddisk-gw8 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreplicatedmergetreeencrypteddisk-gw8 are DRIVER VOLUME NAME Docker volumes for project roottestreplicatedmergetreeencrypteddisk-gw8 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestreplicatedmergetreeencrypteddisk-gw8-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestreplicatedmergetreeencrypteddisk-gw8-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestreplicatedmergetreeencrypteddisk-gw8 No running containers for project: roottestreplicatedmergetreeencrypteddisk-gw8 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:5 Stdout:5 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 5 Volumes pruned: 5 Setup directory for instance: node1 Setup directory for instance: node1 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/configs/remote_servers.xml', '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/configs/storage.xml'] to /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/node1/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/configs/remote_servers.xml', '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/configs/storage.xml'] to /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/node1/configs/config.d Setup database dir /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/node1/database Setup database dir /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/node1/database Setup logs dir /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/node1/logs Setup logs dir /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/node1/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Setup directory for instance: node2 Setup directory for instance: node2 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/configs/remote_servers.xml', '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/configs/storage.xml'] to /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/node2/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/configs/remote_servers.xml', '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/configs/storage.xml'] to /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/node2/configs/config.d Setup database dir /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/node2/database Setup database dir /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/node2/database Setup logs dir /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/node2/logs Setup logs dir /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/node2/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/keeper3/coordination'} stored in /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/keeper3/coordination'} stored in /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/.env --project-name roottestreplicatedmergetreeencrypteddisk-gw8 --file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/node2/docker-compose.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/.env --project-name roottestreplicatedmergetreeencrypteddisk-gw8 --file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/node2/docker-compose.yml pull] Connection dropped: socket connection error: None Connection dropped: socket connection error: None Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-resolver-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-resolver-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-node1-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-node1-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-node1-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-node1-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-resolver-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-resolver-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy2-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy2-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy2-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy2-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/.env --project-name roottestreplicatedmergetreereplicateddbttl-gw3 --file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/.env --project-name roottestreplicatedmergetreereplicateddbttl-gw3 --file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml down --volumes] Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-node1-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-node1-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-resolver-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-resolver-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-node1-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-node1-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-node1-1 Removing Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-node1-1 Removing Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-resolver-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-resolver-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-resolver-1 Removing Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-resolver-1 Removing Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-node1-1 Removed Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-node1-1 Removed Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1 Removing Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1 Removing Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 Removing Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 Removing Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 Removing Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 Removing Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 Removing Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 Removing Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-resolver-1 Removed Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-resolver-1 Removed Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 Removed Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 Removed Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 Removed Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 Removed Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 Removed Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 Removed Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1 Removed Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1 Removed Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy2-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy2-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1 Removing Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1 Removing Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy2-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy2-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy2-1 Removing Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy2-1 Removing Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy2-1 Removed Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy2-1 Removed Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1 Removed Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1 Removed Stderr: Volume roottestreplicatedmergetreereplicateddbttl-gw3_data1-1 Removing Stderr: Volume roottestreplicatedmergetreereplicateddbttl-gw3_data1-1 Removing Stderr: Network roottestreplicatedmergetreereplicateddbttl-gw3_default Removing Stderr: Network roottestreplicatedmergetreereplicateddbttl-gw3_default Removing Stderr: Volume roottestreplicatedmergetreereplicateddbttl-gw3_data1-1 Removed Stderr: Volume roottestreplicatedmergetreereplicateddbttl-gw3_data1-1 Removed Stderr: Network roottestreplicatedmergetreereplicateddbttl-gw3_default Removed Stderr: Network roottestreplicatedmergetreereplicateddbttl-gw3_default Removed Cleanup called Cleanup called Docker networks for project roottestreplicatedmergetreereplicateddbttl-gw3 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicatedmergetreereplicateddbttl-gw3 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestreplicatedmergetreereplicateddbttl-gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicatedmergetreereplicateddbttl-gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreplicatedmergetreereplicateddbttl-gw3 are DRIVER VOLUME NAME Docker volumes for project roottestreplicatedmergetreereplicateddbttl-gw3 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestreplicatedmergetreereplicateddbttl-gw3-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestreplicatedmergetreereplicateddbttl-gw3-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestreplicatedmergetreereplicateddbttl-gw3 No running containers for project: roottestreplicatedmergetreereplicateddbttl-gw3 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:3 Stdout:3 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 3 Volumes pruned: 3 Stderr: node2 Skipped - Image is already being pulled by zoo1 Stderr: node2 Skipped - Image is already being pulled by zoo1 Stderr: node1 Skipped - Image is already being pulled by zoo1 Stderr: node1 Skipped - Image is already being pulled by zoo1 Stderr: zoo2 Skipped - Image is already being pulled by zoo1 Stderr: zoo2 Skipped - Image is already being pulled by zoo1 Stderr: zoo3 Skipped - Image is already being pulled by zoo1 Stderr: zoo3 Skipped - Image is already being pulled by zoo1 Stderr: zoo1 Pulling Stderr: zoo1 Pulling Stderr: zoo1 Pulled Stderr: zoo1 Pulled Setup ZooKeeper Setup ZooKeeper Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/keeper1/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/keeper1/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/keeper1/coordination', '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/keeper2/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/keeper2/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/keeper2/coordination', '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/keeper3/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/keeper3/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/keeper3/coordination'] Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/keeper1/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/keeper1/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/keeper1/coordination', '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/keeper2/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/keeper2/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/keeper2/coordination', '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/keeper3/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/keeper3/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/keeper3/coordination'] Command:[docker compose --project-name roottestreplicatedmergetreeencrypteddisk-gw8 --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Command:[docker compose --project-name roottestreplicatedmergetreeencrypteddisk-gw8 --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Stderr:time="2025-04-02T02:56:52Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:56:52Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottestreplicatedmergetreeencrypteddisk-gw8_default Creating Stderr: Network roottestreplicatedmergetreeencrypteddisk-gw8_default Creating Stderr: Network roottestreplicatedmergetreeencrypteddisk-gw8_default Created Stderr: Network roottestreplicatedmergetreeencrypteddisk-gw8_default Created Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo2-1 Creating Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo2-1 Creating Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo1-1 Creating Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo1-1 Creating Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo3-1 Creating Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo3-1 Creating Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo2-1 Created Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo2-1 Created Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo3-1 Created Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo3-1 Created Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo1-1 Created Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo1-1 Created Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo1-1 Starting Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo1-1 Starting Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo2-1 Starting Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo2-1 Starting Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo3-1 Starting Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo3-1 Starting Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo1-1 Started Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo1-1 Started Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo2-1 Started Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo2-1 Started Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo3-1 Started Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo3-1 Started Stderr:time="2025-04-02T02:56:53Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:56:53Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:56:53Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:56:53Z" level=debug msg="otel error" error="" Wait ZooKeeper to start Wait ZooKeeper to start get_instance_ip instance_name=zoo1 get_instance_ip instance_name=zoo1 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreeencrypteddisk-gw8-zoo1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreeencrypteddisk-gw8-zoo1-1/json HTTP/1.1" 200 None get_kazoo_client: zoo1, ip:172.16.1.4, port:2181, use_ssl:False get_kazoo_client: zoo1, ip:172.16.1.4, port:2181, use_ssl:False Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Stderr: Container roottests3storageconfnewproxy-gw6-node-1 Stopping Stderr: Container roottests3storageconfnewproxy-gw6-node-1 Stopping Stderr: Container roottests3storageconfnewproxy-gw6-resolver-1 Stopping Stderr: Container roottests3storageconfnewproxy-gw6-resolver-1 Stopping Stderr: Container roottests3storageconfnewproxy-gw6-node-1 Stopped Stderr: Container roottests3storageconfnewproxy-gw6-node-1 Stopped Stderr: Container roottests3storageconfnewproxy-gw6-minio1-1 Stopping Stderr: Container roottests3storageconfnewproxy-gw6-minio1-1 Stopping Stderr: Container roottests3storageconfnewproxy-gw6-minio1-1 Stopped Stderr: Container roottests3storageconfnewproxy-gw6-minio1-1 Stopped Stderr: Container roottests3storageconfnewproxy-gw6-resolver-1 Stopped Stderr: Container roottests3storageconfnewproxy-gw6-resolver-1 Stopped Stderr: Container roottests3storageconfnewproxy-gw6-proxy2-1 Stopping Stderr: Container roottests3storageconfnewproxy-gw6-proxy2-1 Stopping Stderr: Container roottests3storageconfnewproxy-gw6-proxy1-1 Stopping Stderr: Container roottests3storageconfnewproxy-gw6-proxy1-1 Stopping Stderr: Container roottests3storageconfnewproxy-gw6-proxy2-1 Stopped Stderr: Container roottests3storageconfnewproxy-gw6-proxy2-1 Stopped Stderr: Container roottests3storageconfnewproxy-gw6-proxy1-1 Stopped Stderr: Container roottests3storageconfnewproxy-gw6-proxy1-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/.env --project-name roottests3storageconfnewproxy-gw6 --file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/.env --project-name roottests3storageconfnewproxy-gw6 --file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml down --volumes] Stderr: Container roottests3storageconfnewproxy-gw6-resolver-1 Stopping Stderr: Container roottests3storageconfnewproxy-gw6-resolver-1 Stopping Stderr: Container roottests3storageconfnewproxy-gw6-node-1 Stopping Stderr: Container roottests3storageconfnewproxy-gw6-node-1 Stopping Stderr: Container roottests3storageconfnewproxy-gw6-resolver-1 Stopped Stderr: Container roottests3storageconfnewproxy-gw6-resolver-1 Stopped Stderr: Container roottests3storageconfnewproxy-gw6-resolver-1 Removing Stderr: Container roottests3storageconfnewproxy-gw6-resolver-1 Removing Stderr: Container roottests3storageconfnewproxy-gw6-node-1 Stopped Stderr: Container roottests3storageconfnewproxy-gw6-node-1 Stopped Stderr: Container roottests3storageconfnewproxy-gw6-node-1 Removing Stderr: Container roottests3storageconfnewproxy-gw6-node-1 Removing Stderr: Container roottests3storageconfnewproxy-gw6-resolver-1 Removed Stderr: Container roottests3storageconfnewproxy-gw6-resolver-1 Removed Stderr: Container roottests3storageconfnewproxy-gw6-node-1 Removed Stderr: Container roottests3storageconfnewproxy-gw6-node-1 Removed Stderr: Container roottests3storageconfnewproxy-gw6-minio1-1 Stopping Stderr: Container roottests3storageconfnewproxy-gw6-minio1-1 Stopping Stderr: Container roottests3storageconfnewproxy-gw6-minio1-1 Stopped Stderr: Container roottests3storageconfnewproxy-gw6-minio1-1 Stopped Stderr: Container roottests3storageconfnewproxy-gw6-minio1-1 Removing Stderr: Container roottests3storageconfnewproxy-gw6-minio1-1 Removing Stderr: Container roottests3storageconfnewproxy-gw6-minio1-1 Removed Stderr: Container roottests3storageconfnewproxy-gw6-minio1-1 Removed Stderr: Container roottests3storageconfnewproxy-gw6-proxy1-1 Stopping Stderr: Container roottests3storageconfnewproxy-gw6-proxy1-1 Stopping Stderr: Container roottests3storageconfnewproxy-gw6-proxy2-1 Stopping Stderr: Container roottests3storageconfnewproxy-gw6-proxy2-1 Stopping Stderr: Container roottests3storageconfnewproxy-gw6-proxy1-1 Stopped Stderr: Container roottests3storageconfnewproxy-gw6-proxy1-1 Stopped Stderr: Container roottests3storageconfnewproxy-gw6-proxy1-1 Removing Stderr: Container roottests3storageconfnewproxy-gw6-proxy1-1 Removing Stderr: Container roottests3storageconfnewproxy-gw6-proxy2-1 Stopped Stderr: Container roottests3storageconfnewproxy-gw6-proxy2-1 Stopped Stderr: Container roottests3storageconfnewproxy-gw6-proxy2-1 Removing Stderr: Container roottests3storageconfnewproxy-gw6-proxy2-1 Removing Stderr: Container roottests3storageconfnewproxy-gw6-proxy1-1 Removed Stderr: Container roottests3storageconfnewproxy-gw6-proxy1-1 Removed Stderr: Container roottests3storageconfnewproxy-gw6-proxy2-1 Removed Stderr: Container roottests3storageconfnewproxy-gw6-proxy2-1 Removed Stderr: Volume roottests3storageconfnewproxy-gw6_data1-1 Removing Stderr: Volume roottests3storageconfnewproxy-gw6_data1-1 Removing Stderr: Network roottests3storageconfnewproxy-gw6_default Removing Stderr: Network roottests3storageconfnewproxy-gw6_default Removing Stderr: Volume roottests3storageconfnewproxy-gw6_data1-1 Removed Stderr: Volume roottests3storageconfnewproxy-gw6_data1-1 Removed Stderr: Network roottests3storageconfnewproxy-gw6_default Removed Stderr: Network roottests3storageconfnewproxy-gw6_default Removed Cleanup called Cleanup called Docker networks for project roottests3storageconfnewproxy-gw6 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3storageconfnewproxy-gw6 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3storageconfnewproxy-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3storageconfnewproxy-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3storageconfnewproxy-gw6 are DRIVER VOLUME NAME Docker volumes for project roottests3storageconfnewproxy-gw6 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottests3storageconfnewproxy-gw6-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottests3storageconfnewproxy-gw6-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottests3storageconfnewproxy-gw6 No running containers for project: roottests3storageconfnewproxy-gw6 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:1 Stdout:1 Volumes pruned: 1 Volumes pruned: 1 Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo2 get_instance_ip instance_name=zoo2 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreeencrypteddisk-gw8-zoo2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreeencrypteddisk-gw8-zoo2-1/json HTTP/1.1" 200 None get_kazoo_client: zoo2, ip:172.16.1.3, port:2181, use_ssl:False get_kazoo_client: zoo2, ip:172.16.1.3, port:2181, use_ssl:False Connecting to 172.16.1.3(172.16.1.3):2181, use_ssl: False Connecting to 172.16.1.3(172.16.1.3):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Connection dropped: socket connection error: None Connection dropped: socket connection error: None Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo3 get_instance_ip instance_name=zoo3 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreeencrypteddisk-gw8-zoo3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreeencrypteddisk-gw8-zoo3-1/json HTTP/1.1" 200 None get_kazoo_client: zoo3, ip:172.16.1.2, port:2181, use_ssl:False get_kazoo_client: zoo3, ip:172.16.1.2, port:2181, use_ssl:False Connecting to 172.16.1.2(172.16.1.2):2181, use_ssl: False Connecting to 172.16.1.2(172.16.1.2):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/.env --project-name roottestreplicatedmergetreeencrypteddisk-gw8 --file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/node2/docker-compose.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/.env --project-name roottestreplicatedmergetreeencrypteddisk-gw8 --file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/node2/docker-compose.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/.env --project-name roottestreplicatedmergetreeencrypteddisk-gw8 --file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/node2/docker-compose.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/.env --project-name roottestreplicatedmergetreeencrypteddisk-gw8 --file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/node2/docker-compose.yml up -d --no-recreate] Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo3-1 Running Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo3-1 Running Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo1-1 Running Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo1-1 Running Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo2-1 Running Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo2-1 Running Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-node2-1 Creating Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-node2-1 Creating Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-node1-1 Creating Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-node1-1 Creating Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-node1-1 Created Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-node1-1 Created Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-node2-1 Created Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-node2-1 Created Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-node2-1 Starting Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-node2-1 Starting Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-node1-1 Starting Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-node1-1 Starting Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-node1-1 Started Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-node1-1 Started Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-node2-1 Started Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-node2-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node1 get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreeencrypteddisk-gw8-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreeencrypteddisk-gw8-node1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node1 get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreeencrypteddisk-gw8-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreeencrypteddisk-gw8-node1-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node1, ip: 172.16.1.6... Waiting for ClickHouse start in node1, ip: 172.16.1.6... http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreeencrypteddisk-gw8-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreeencrypteddisk-gw8-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3aeffa481710f1bdae669e980027ffda8404ec50079e6fe60aeb0dcb761d5569/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3aeffa481710f1bdae669e980027ffda8404ec50079e6fe60aeb0dcb761d5569/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3aeffa481710f1bdae669e980027ffda8404ec50079e6fe60aeb0dcb761d5569/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3aeffa481710f1bdae669e980027ffda8404ec50079e6fe60aeb0dcb761d5569/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3aeffa481710f1bdae669e980027ffda8404ec50079e6fe60aeb0dcb761d5569/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3aeffa481710f1bdae669e980027ffda8404ec50079e6fe60aeb0dcb761d5569/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3aeffa481710f1bdae669e980027ffda8404ec50079e6fe60aeb0dcb761d5569/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3aeffa481710f1bdae669e980027ffda8404ec50079e6fe60aeb0dcb761d5569/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3aeffa481710f1bdae669e980027ffda8404ec50079e6fe60aeb0dcb761d5569/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3aeffa481710f1bdae669e980027ffda8404ec50079e6fe60aeb0dcb761d5569/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3aeffa481710f1bdae669e980027ffda8404ec50079e6fe60aeb0dcb761d5569/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3aeffa481710f1bdae669e980027ffda8404ec50079e6fe60aeb0dcb761d5569/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3aeffa481710f1bdae669e980027ffda8404ec50079e6fe60aeb0dcb761d5569/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3aeffa481710f1bdae669e980027ffda8404ec50079e6fe60aeb0dcb761d5569/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3aeffa481710f1bdae669e980027ffda8404ec50079e6fe60aeb0dcb761d5569/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3aeffa481710f1bdae669e980027ffda8404ec50079e6fe60aeb0dcb761d5569/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3aeffa481710f1bdae669e980027ffda8404ec50079e6fe60aeb0dcb761d5569/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3aeffa481710f1bdae669e980027ffda8404ec50079e6fe60aeb0dcb761d5569/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3aeffa481710f1bdae669e980027ffda8404ec50079e6fe60aeb0dcb761d5569/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3aeffa481710f1bdae669e980027ffda8404ec50079e6fe60aeb0dcb761d5569/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3aeffa481710f1bdae669e980027ffda8404ec50079e6fe60aeb0dcb761d5569/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3aeffa481710f1bdae669e980027ffda8404ec50079e6fe60aeb0dcb761d5569/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3aeffa481710f1bdae669e980027ffda8404ec50079e6fe60aeb0dcb761d5569/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3aeffa481710f1bdae669e980027ffda8404ec50079e6fe60aeb0dcb761d5569/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3aeffa481710f1bdae669e980027ffda8404ec50079e6fe60aeb0dcb761d5569/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3aeffa481710f1bdae669e980027ffda8404ec50079e6fe60aeb0dcb761d5569/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3aeffa481710f1bdae669e980027ffda8404ec50079e6fe60aeb0dcb761d5569/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3aeffa481710f1bdae669e980027ffda8404ec50079e6fe60aeb0dcb761d5569/json HTTP/1.1" 200 None ClickHouse node1 started ClickHouse node1 started get_instance_ip instance_name=node2 get_instance_ip instance_name=node2 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreeencrypteddisk-gw8-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreeencrypteddisk-gw8-node2-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node2 get_instance_ip instance_name=node2 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreeencrypteddisk-gw8-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreeencrypteddisk-gw8-node2-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node2, ip: 172.16.1.5... Waiting for ClickHouse start in node2, ip: 172.16.1.5... http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreeencrypteddisk-gw8-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreeencrypteddisk-gw8-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/1ee6c9c321a50564e208001d7c4e082fbc45f3fb56706b2952027beb5c1edd15/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/1ee6c9c321a50564e208001d7c4e082fbc45f3fb56706b2952027beb5c1edd15/json HTTP/1.1" 200 None ClickHouse node2 started ClickHouse node2 started run container_id:roottestreplicatedmergetreeencrypteddisk-gw8-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname /etc/clickhouse-server/config.d/z_keys.xml) && echo PGNsaWNraG91c2U+CiAgICA8c3RvcmFnZV9jb25maWd1cmF0aW9uPgogICAgICAgIDxkaXNrcz4KICAgICAgICAgICAgPGRpc2tfZW5jcnlwdGVkPgogICAgICAgICAgICAgICAgPGtleT5hYWFhYWFhYWFhYWFhYWFhPC9rZXk+CiAgICAgICAgICAgIDwvZGlza19lbmNyeXB0ZWQ+CiAgICAgICAgPC9kaXNrcz4KICAgIDwvc3RvcmFnZV9jb25maWd1cmF0aW9uPgo8L2NsaWNraG91c2U+Cg== | base64 --decode > /etc/clickhouse-server/config.d/z_keys.xml'] run container_id:roottestreplicatedmergetreeencrypteddisk-gw8-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname /etc/clickhouse-server/config.d/z_keys.xml) && echo PGNsaWNraG91c2U+CiAgICA8c3RvcmFnZV9jb25maWd1cmF0aW9uPgogICAgICAgIDxkaXNrcz4KICAgICAgICAgICAgPGRpc2tfZW5jcnlwdGVkPgogICAgICAgICAgICAgICAgPGtleT5hYWFhYWFhYWFhYWFhYWFhPC9rZXk+CiAgICAgICAgICAgIDwvZGlza19lbmNyeXB0ZWQ+CiAgICAgICAgPC9kaXNrcz4KICAgIDwvc3RvcmFnZV9jb25maWd1cmF0aW9uPgo8L2NsaWNraG91c2U+Cg== | base64 --decode > /etc/clickhouse-server/config.d/z_keys.xml'] Command:[docker exec roottestreplicatedmergetreeencrypteddisk-gw8-node1-1 bash -c mkdir -p $(dirname /etc/clickhouse-server/config.d/z_keys.xml) && echo PGNsaWNraG91c2U+CiAgICA8c3RvcmFnZV9jb25maWd1cmF0aW9uPgogICAgICAgIDxkaXNrcz4KICAgICAgICAgICAgPGRpc2tfZW5jcnlwdGVkPgogICAgICAgICAgICAgICAgPGtleT5hYWFhYWFhYWFhYWFhYWFhPC9rZXk+CiAgICAgICAgICAgIDwvZGlza19lbmNyeXB0ZWQ+CiAgICAgICAgPC9kaXNrcz4KICAgIDwvc3RvcmFnZV9jb25maWd1cmF0aW9uPgo8L2NsaWNraG91c2U+Cg== | base64 --decode > /etc/clickhouse-server/config.d/z_keys.xml] Command:[docker exec roottestreplicatedmergetreeencrypteddisk-gw8-node1-1 bash -c mkdir -p $(dirname /etc/clickhouse-server/config.d/z_keys.xml) && echo PGNsaWNraG91c2U+CiAgICA8c3RvcmFnZV9jb25maWd1cmF0aW9uPgogICAgICAgIDxkaXNrcz4KICAgICAgICAgICAgPGRpc2tfZW5jcnlwdGVkPgogICAgICAgICAgICAgICAgPGtleT5hYWFhYWFhYWFhYWFhYWFhPC9rZXk+CiAgICAgICAgICAgIDwvZGlza19lbmNyeXB0ZWQ+CiAgICAgICAgPC9kaXNrcz4KICAgIDwvc3RvcmFnZV9jb25maWd1cmF0aW9uPgo8L2NsaWNraG91c2U+Cg== | base64 --decode > /etc/clickhouse-server/config.d/z_keys.xml] Executing query SYSTEM RELOAD CONFIG on node1 Executing query SYSTEM RELOAD CONFIG on node1 run container_id:roottestreplicatedmergetreeencrypteddisk-gw8-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname /etc/clickhouse-server/config.d/z_keys.xml) && echo PGNsaWNraG91c2U+CiAgICA8c3RvcmFnZV9jb25maWd1cmF0aW9uPgogICAgICAgIDxkaXNrcz4KICAgICAgICAgICAgPGRpc2tfZW5jcnlwdGVkPgogICAgICAgICAgICAgICAgPGtleT5iYmJiYmJiYmJiYmJiYmJiPC9rZXk+CiAgICAgICAgICAgIDwvZGlza19lbmNyeXB0ZWQ+CiAgICAgICAgPC9kaXNrcz4KICAgIDwvc3RvcmFnZV9jb25maWd1cmF0aW9uPgo8L2NsaWNraG91c2U+Cg== | base64 --decode > /etc/clickhouse-server/config.d/z_keys.xml'] run container_id:roottestreplicatedmergetreeencrypteddisk-gw8-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname /etc/clickhouse-server/config.d/z_keys.xml) && echo PGNsaWNraG91c2U+CiAgICA8c3RvcmFnZV9jb25maWd1cmF0aW9uPgogICAgICAgIDxkaXNrcz4KICAgICAgICAgICAgPGRpc2tfZW5jcnlwdGVkPgogICAgICAgICAgICAgICAgPGtleT5iYmJiYmJiYmJiYmJiYmJiPC9rZXk+CiAgICAgICAgICAgIDwvZGlza19lbmNyeXB0ZWQ+CiAgICAgICAgPC9kaXNrcz4KICAgIDwvc3RvcmFnZV9jb25maWd1cmF0aW9uPgo8L2NsaWNraG91c2U+Cg== | base64 --decode > /etc/clickhouse-server/config.d/z_keys.xml'] Command:[docker exec roottestreplicatedmergetreeencrypteddisk-gw8-node2-1 bash -c mkdir -p $(dirname /etc/clickhouse-server/config.d/z_keys.xml) && echo PGNsaWNraG91c2U+CiAgICA8c3RvcmFnZV9jb25maWd1cmF0aW9uPgogICAgICAgIDxkaXNrcz4KICAgICAgICAgICAgPGRpc2tfZW5jcnlwdGVkPgogICAgICAgICAgICAgICAgPGtleT5iYmJiYmJiYmJiYmJiYmJiPC9rZXk+CiAgICAgICAgICAgIDwvZGlza19lbmNyeXB0ZWQ+CiAgICAgICAgPC9kaXNrcz4KICAgIDwvc3RvcmFnZV9jb25maWd1cmF0aW9uPgo8L2NsaWNraG91c2U+Cg== | base64 --decode > /etc/clickhouse-server/config.d/z_keys.xml] Command:[docker exec roottestreplicatedmergetreeencrypteddisk-gw8-node2-1 bash -c mkdir -p $(dirname /etc/clickhouse-server/config.d/z_keys.xml) && echo PGNsaWNraG91c2U+CiAgICA8c3RvcmFnZV9jb25maWd1cmF0aW9uPgogICAgICAgIDxkaXNrcz4KICAgICAgICAgICAgPGRpc2tfZW5jcnlwdGVkPgogICAgICAgICAgICAgICAgPGtleT5iYmJiYmJiYmJiYmJiYmJiPC9rZXk+CiAgICAgICAgICAgIDwvZGlza19lbmNyeXB0ZWQ+CiAgICAgICAgPC9kaXNrcz4KICAgIDwvc3RvcmFnZV9jb25maWd1cmF0aW9uPgo8L2NsaWNraG91c2U+Cg== | base64 --decode > /etc/clickhouse-server/config.d/z_keys.xml] Executing query SYSTEM RELOAD CONFIG on node2 Executing query SYSTEM RELOAD CONFIG on node2 Executing query DROP TABLE IF EXISTS tbl ON CLUSTER 'cluster' SYNC on node1 Executing query DROP TABLE IF EXISTS tbl ON CLUSTER 'cluster' SYNC on node1 Executing query CREATE TABLE tbl ON CLUSTER 'cluster' ( id Int64, str String ) ENGINE=ReplicatedMergeTree('/clickhouse/tables/tbl/', '{replica}') ORDER BY id SETTINGS storage_policy='encrypted_policy' on node1 Executing query CREATE TABLE tbl ON CLUSTER 'cluster' ( id Int64, str String ) ENGINE=ReplicatedMergeTree('/clickhouse/tables/tbl/', '{replica}') ORDER BY id SETTINGS storage_policy='encrypted_policy' on node1 Executing query INSERT INTO tbl VALUES (1, 'str1') on node1 Executing query INSERT INTO tbl VALUES (1, 'str1') on node1 Executing query INSERT INTO tbl VALUES (1, 'str1') on node2 Executing query INSERT INTO tbl VALUES (1, 'str1') on node2 Executing query INSERT INTO tbl VALUES (2, 'str2') on node2 Executing query INSERT INTO tbl VALUES (2, 'str2') on node2 Executing query SYSTEM SYNC REPLICA tbl LIGHTWEIGHT on node1 Executing query SYSTEM SYNC REPLICA tbl LIGHTWEIGHT on node1 Executing query SYSTEM SYNC REPLICA tbl LIGHTWEIGHT on node2 Executing query SYSTEM SYNC REPLICA tbl LIGHTWEIGHT on node2 Executing query SELECT * FROM tbl ORDER BY id on node1 Executing query SELECT * FROM tbl ORDER BY id on node1 Executing query SELECT * FROM tbl ORDER BY id on node2 Executing query SELECT * FROM tbl ORDER BY id on node2 Executing query CHECK TABLE tbl on node1 Executing query CHECK TABLE tbl on node1 Executing query CHECK TABLE tbl on node2 Executing query CHECK TABLE tbl on node2 Executing query OPTIMIZE TABLE tbl ON CLUSTER 'cluster' FINAL on node1 Executing query OPTIMIZE TABLE tbl ON CLUSTER 'cluster' FINAL on node1 Executing query SYSTEM SYNC REPLICA tbl LIGHTWEIGHT on node1 Executing query SYSTEM SYNC REPLICA tbl LIGHTWEIGHT on node1 Executing query SYSTEM SYNC REPLICA tbl LIGHTWEIGHT on node2 Executing query SYSTEM SYNC REPLICA tbl LIGHTWEIGHT on node2 Executing query SELECT * FROM tbl ORDER BY id on node1 Executing query SELECT * FROM tbl ORDER BY id on node1 Executing query SELECT * FROM tbl ORDER BY id on node2 Executing query SELECT * FROM tbl ORDER BY id on node2 Executing query CHECK TABLE tbl on node1 Executing query CHECK TABLE tbl on node1 Executing query CHECK TABLE tbl on node2 Executing query CHECK TABLE tbl on node2 [gw8] PASSED test_replicated_merge_tree_encrypted_disk/test.py::test_different_keys test_replicated_merge_tree_encrypted_disk/test.py::test_same_keys run container_id:roottestreplicatedmergetreeencrypteddisk-gw8-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname /etc/clickhouse-server/config.d/z_keys.xml) && echo PGNsaWNraG91c2U+CiAgICA8c3RvcmFnZV9jb25maWd1cmF0aW9uPgogICAgICAgIDxkaXNrcz4KICAgICAgICAgICAgPGRpc2tfZW5jcnlwdGVkPgogICAgICAgICAgICAgICAgPGtleT5hYWFhYWFhYWFhYWFhYWFhPC9rZXk+CiAgICAgICAgICAgIDwvZGlza19lbmNyeXB0ZWQ+CiAgICAgICAgPC9kaXNrcz4KICAgIDwvc3RvcmFnZV9jb25maWd1cmF0aW9uPgo8L2NsaWNraG91c2U+Cg== | base64 --decode > /etc/clickhouse-server/config.d/z_keys.xml'] run container_id:roottestreplicatedmergetreeencrypteddisk-gw8-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname /etc/clickhouse-server/config.d/z_keys.xml) && echo PGNsaWNraG91c2U+CiAgICA8c3RvcmFnZV9jb25maWd1cmF0aW9uPgogICAgICAgIDxkaXNrcz4KICAgICAgICAgICAgPGRpc2tfZW5jcnlwdGVkPgogICAgICAgICAgICAgICAgPGtleT5hYWFhYWFhYWFhYWFhYWFhPC9rZXk+CiAgICAgICAgICAgIDwvZGlza19lbmNyeXB0ZWQ+CiAgICAgICAgPC9kaXNrcz4KICAgIDwvc3RvcmFnZV9jb25maWd1cmF0aW9uPgo8L2NsaWNraG91c2U+Cg== | base64 --decode > /etc/clickhouse-server/config.d/z_keys.xml'] Command:[docker exec roottestreplicatedmergetreeencrypteddisk-gw8-node1-1 bash -c mkdir -p $(dirname /etc/clickhouse-server/config.d/z_keys.xml) && echo PGNsaWNraG91c2U+CiAgICA8c3RvcmFnZV9jb25maWd1cmF0aW9uPgogICAgICAgIDxkaXNrcz4KICAgICAgICAgICAgPGRpc2tfZW5jcnlwdGVkPgogICAgICAgICAgICAgICAgPGtleT5hYWFhYWFhYWFhYWFhYWFhPC9rZXk+CiAgICAgICAgICAgIDwvZGlza19lbmNyeXB0ZWQ+CiAgICAgICAgPC9kaXNrcz4KICAgIDwvc3RvcmFnZV9jb25maWd1cmF0aW9uPgo8L2NsaWNraG91c2U+Cg== | base64 --decode > /etc/clickhouse-server/config.d/z_keys.xml] Command:[docker exec roottestreplicatedmergetreeencrypteddisk-gw8-node1-1 bash -c mkdir -p $(dirname /etc/clickhouse-server/config.d/z_keys.xml) && echo PGNsaWNraG91c2U+CiAgICA8c3RvcmFnZV9jb25maWd1cmF0aW9uPgogICAgICAgIDxkaXNrcz4KICAgICAgICAgICAgPGRpc2tfZW5jcnlwdGVkPgogICAgICAgICAgICAgICAgPGtleT5hYWFhYWFhYWFhYWFhYWFhPC9rZXk+CiAgICAgICAgICAgIDwvZGlza19lbmNyeXB0ZWQ+CiAgICAgICAgPC9kaXNrcz4KICAgIDwvc3RvcmFnZV9jb25maWd1cmF0aW9uPgo8L2NsaWNraG91c2U+Cg== | base64 --decode > /etc/clickhouse-server/config.d/z_keys.xml] Executing query SYSTEM RELOAD CONFIG on node1 Executing query SYSTEM RELOAD CONFIG on node1 run container_id:roottestreplicatedmergetreeencrypteddisk-gw8-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname /etc/clickhouse-server/config.d/z_keys.xml) && echo PGNsaWNraG91c2U+CiAgICA8c3RvcmFnZV9jb25maWd1cmF0aW9uPgogICAgICAgIDxkaXNrcz4KICAgICAgICAgICAgPGRpc2tfZW5jcnlwdGVkPgogICAgICAgICAgICAgICAgPGtleT5hYWFhYWFhYWFhYWFhYWFhPC9rZXk+CiAgICAgICAgICAgIDwvZGlza19lbmNyeXB0ZWQ+CiAgICAgICAgPC9kaXNrcz4KICAgIDwvc3RvcmFnZV9jb25maWd1cmF0aW9uPgo8L2NsaWNraG91c2U+Cg== | base64 --decode > /etc/clickhouse-server/config.d/z_keys.xml'] run container_id:roottestreplicatedmergetreeencrypteddisk-gw8-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname /etc/clickhouse-server/config.d/z_keys.xml) && echo PGNsaWNraG91c2U+CiAgICA8c3RvcmFnZV9jb25maWd1cmF0aW9uPgogICAgICAgIDxkaXNrcz4KICAgICAgICAgICAgPGRpc2tfZW5jcnlwdGVkPgogICAgICAgICAgICAgICAgPGtleT5hYWFhYWFhYWFhYWFhYWFhPC9rZXk+CiAgICAgICAgICAgIDwvZGlza19lbmNyeXB0ZWQ+CiAgICAgICAgPC9kaXNrcz4KICAgIDwvc3RvcmFnZV9jb25maWd1cmF0aW9uPgo8L2NsaWNraG91c2U+Cg== | base64 --decode > /etc/clickhouse-server/config.d/z_keys.xml'] Command:[docker exec roottestreplicatedmergetreeencrypteddisk-gw8-node2-1 bash -c mkdir -p $(dirname /etc/clickhouse-server/config.d/z_keys.xml) && echo PGNsaWNraG91c2U+CiAgICA8c3RvcmFnZV9jb25maWd1cmF0aW9uPgogICAgICAgIDxkaXNrcz4KICAgICAgICAgICAgPGRpc2tfZW5jcnlwdGVkPgogICAgICAgICAgICAgICAgPGtleT5hYWFhYWFhYWFhYWFhYWFhPC9rZXk+CiAgICAgICAgICAgIDwvZGlza19lbmNyeXB0ZWQ+CiAgICAgICAgPC9kaXNrcz4KICAgIDwvc3RvcmFnZV9jb25maWd1cmF0aW9uPgo8L2NsaWNraG91c2U+Cg== | base64 --decode > /etc/clickhouse-server/config.d/z_keys.xml] Command:[docker exec roottestreplicatedmergetreeencrypteddisk-gw8-node2-1 bash -c mkdir -p $(dirname /etc/clickhouse-server/config.d/z_keys.xml) && echo PGNsaWNraG91c2U+CiAgICA8c3RvcmFnZV9jb25maWd1cmF0aW9uPgogICAgICAgIDxkaXNrcz4KICAgICAgICAgICAgPGRpc2tfZW5jcnlwdGVkPgogICAgICAgICAgICAgICAgPGtleT5hYWFhYWFhYWFhYWFhYWFhPC9rZXk+CiAgICAgICAgICAgIDwvZGlza19lbmNyeXB0ZWQ+CiAgICAgICAgPC9kaXNrcz4KICAgIDwvc3RvcmFnZV9jb25maWd1cmF0aW9uPgo8L2NsaWNraG91c2U+Cg== | base64 --decode > /etc/clickhouse-server/config.d/z_keys.xml] Executing query SYSTEM RELOAD CONFIG on node2 Executing query SYSTEM RELOAD CONFIG on node2 Executing query DROP TABLE IF EXISTS tbl ON CLUSTER 'cluster' SYNC on node1 Executing query DROP TABLE IF EXISTS tbl ON CLUSTER 'cluster' SYNC on node1 Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query CREATE TABLE tbl ON CLUSTER 'cluster' ( id Int64, str String ) ENGINE=ReplicatedMergeTree('/clickhouse/tables/tbl/', '{replica}') ORDER BY id SETTINGS storage_policy='encrypted_policy' on node1 Executing query CREATE TABLE tbl ON CLUSTER 'cluster' ( id Int64, str String ) ENGINE=ReplicatedMergeTree('/clickhouse/tables/tbl/', '{replica}') ORDER BY id SETTINGS storage_policy='encrypted_policy' on node1 Executing query INSERT INTO tbl VALUES (1, 'str1') on node1 Executing query INSERT INTO tbl VALUES (1, 'str1') on node1 Executing query INSERT INTO tbl VALUES (1, 'str1') on node2 Executing query INSERT INTO tbl VALUES (1, 'str1') on node2 Executing query INSERT INTO tbl VALUES (2, 'str2') on node2 Executing query INSERT INTO tbl VALUES (2, 'str2') on node2 Executing query SYSTEM SYNC REPLICA tbl LIGHTWEIGHT on node1 Executing query SYSTEM SYNC REPLICA tbl LIGHTWEIGHT on node1 Executing query SYSTEM SYNC REPLICA tbl LIGHTWEIGHT on node2 Executing query SYSTEM SYNC REPLICA tbl LIGHTWEIGHT on node2 Executing query SELECT * FROM tbl ORDER BY id on node1 Executing query SELECT * FROM tbl ORDER BY id on node1 Executing query SELECT * FROM tbl ORDER BY id on node2 Executing query SELECT * FROM tbl ORDER BY id on node2 Executing query CHECK TABLE tbl on node1 Executing query CHECK TABLE tbl on node1 Executing query CHECK TABLE tbl on node2 Executing query CHECK TABLE tbl on node2 Executing query OPTIMIZE TABLE tbl ON CLUSTER 'cluster' FINAL on node1 Executing query OPTIMIZE TABLE tbl ON CLUSTER 'cluster' FINAL on node1 Executing query SYSTEM SYNC REPLICA tbl LIGHTWEIGHT on node1 Executing query SYSTEM SYNC REPLICA tbl LIGHTWEIGHT on node1 Executing query SYSTEM SYNC REPLICA tbl LIGHTWEIGHT on node2 Executing query SYSTEM SYNC REPLICA tbl LIGHTWEIGHT on node2 Executing query SELECT * FROM tbl ORDER BY id on node1 Executing query SELECT * FROM tbl ORDER BY id on node1 Executing query SELECT * FROM tbl ORDER BY id on node2 Executing query SELECT * FROM tbl ORDER BY id on node2 Executing query CHECK TABLE tbl on node1 Executing query CHECK TABLE tbl on node1 Executing query CHECK TABLE tbl on node2 Executing query CHECK TABLE tbl on node2 Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/.env --project-name roottestreplicatedmergetreeencrypteddisk-gw8 --file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/node2/docker-compose.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/.env --project-name roottestreplicatedmergetreeencrypteddisk-gw8 --file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/node2/docker-compose.yml stop --timeout 20] [gw8] PASSED test_replicated_merge_tree_encrypted_disk/test.py::test_same_keys Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-node1-1 Stopping Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-node1-1 Stopping Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-node2-1 Stopping Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-node2-1 Stopping Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-node1-1 Stopped Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-node1-1 Stopped Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-node2-1 Stopped Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-node2-1 Stopped Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo3-1 Stopping Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo3-1 Stopping Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo1-1 Stopping Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo1-1 Stopping Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo2-1 Stopping Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo2-1 Stopping Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo2-1 Stopped Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo2-1 Stopped Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo1-1 Stopped Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo1-1 Stopped Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo3-1 Stopped Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo3-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/node2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/node2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/node2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/node2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/.env --project-name roottestreplicatedmergetreeencrypteddisk-gw8 --file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/node2/docker-compose.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/.env --project-name roottestreplicatedmergetreeencrypteddisk-gw8 --file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw8/node2/docker-compose.yml down --volumes] Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-node1-1 Stopping Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-node1-1 Stopping Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-node2-1 Stopping Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-node2-1 Stopping Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-node1-1 Stopped Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-node1-1 Stopped Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-node1-1 Removing Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-node1-1 Removing Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-node2-1 Stopped Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-node2-1 Stopped Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-node2-1 Removing Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-node2-1 Removing Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-node1-1 Removed Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-node1-1 Removed Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-node2-1 Removed Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-node2-1 Removed Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo1-1 Stopping Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo1-1 Stopping Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo2-1 Stopping Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo2-1 Stopping Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo3-1 Stopping Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo3-1 Stopping Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo1-1 Stopped Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo1-1 Stopped Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo1-1 Removing Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo1-1 Removing Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo2-1 Stopped Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo2-1 Stopped Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo2-1 Removing Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo2-1 Removing Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo3-1 Stopped Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo3-1 Stopped Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo3-1 Removing Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo3-1 Removing Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo1-1 Removed Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo1-1 Removed Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo2-1 Removed Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo2-1 Removed Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo3-1 Removed Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw8-zoo3-1 Removed Stderr: Network roottestreplicatedmergetreeencrypteddisk-gw8_default Removing Stderr: Network roottestreplicatedmergetreeencrypteddisk-gw8_default Removing Stderr: Network roottestreplicatedmergetreeencrypteddisk-gw8_default Removed Stderr: Network roottestreplicatedmergetreeencrypteddisk-gw8_default Removed Cleanup called Cleanup called Docker networks for project roottestreplicatedmergetreeencrypteddisk-gw8 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicatedmergetreeencrypteddisk-gw8 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestreplicatedmergetreeencrypteddisk-gw8 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicatedmergetreeencrypteddisk-gw8 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreplicatedmergetreeencrypteddisk-gw8 are DRIVER VOLUME NAME Docker volumes for project roottestreplicatedmergetreeencrypteddisk-gw8 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestreplicatedmergetreeencrypteddisk-gw8-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestreplicatedmergetreeencrypteddisk-gw8-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestreplicatedmergetreeencrypteddisk-gw8 No running containers for project: roottestreplicatedmergetreeencrypteddisk-gw8 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:1 Stdout:1 Volumes pruned: 1 Volumes pruned: 1 Connection dropped: socket connection error: None Connection dropped: socket connection error: None Connection dropped: socket connection error: None Connection dropped: socket connection error: None Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster' and host_name='node_1' on node Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster' and host_name='node_1' on node Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster2' and host_name='node_1' on node Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster2' and host_name='node_1' on node run container_id:roottestreloadclustersconfig-gw7-node-1 detach:False nothrow:False cmd: ['bash', '-c', "echo '\n\n \n \n \n true\n \n node_1\n 9000\n \n \n node_2\n 9000\n \n \n \n \n\n' > /etc/clickhouse-server/config.d/remote_servers.xml"] run container_id:roottestreloadclustersconfig-gw7-node-1 detach:False nothrow:False cmd: ['bash', '-c', "echo '\n\n \n \n \n true\n \n node_1\n 9000\n \n \n node_2\n 9000\n \n \n \n \n\n' > /etc/clickhouse-server/config.d/remote_servers.xml"] Command:[docker exec roottestreloadclustersconfig-gw7-node-1 bash -c echo ' true node_1 9000 node_2 9000 ' > /etc/clickhouse-server/config.d/remote_servers.xml] Command:[docker exec roottestreloadclustersconfig-gw7-node-1 bash -c echo ' true node_1 9000 node_2 9000 ' > /etc/clickhouse-server/config.d/remote_servers.xml] Executing query SYSTEM RELOAD CONFIG on node Executing query SYSTEM RELOAD CONFIG on node Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster' and host_name='node_1' on node Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster' and host_name='node_1' on node Executing query SELECT * FROM system.clusters WHERE cluster='test_cluster2' on node Executing query SELECT * FROM system.clusters WHERE cluster='test_cluster2' on node run container_id:roottestreloadclustersconfig-gw7-node-1 detach:False nothrow:False cmd: ['bash', '-c', "echo '\n\n \n \n \n true\n \n node_1\n 9000\n \n \n node_2\n 9000\n \n \n \n \n \n true\n \n node_1\n 9000\n \n \n node_2\n 9000\n \n \n \n \n\n' > /etc/clickhouse-server/config.d/remote_servers.xml"] run container_id:roottestreloadclustersconfig-gw7-node-1 detach:False nothrow:False cmd: ['bash', '-c', "echo '\n\n \n \n \n true\n \n node_1\n 9000\n \n \n node_2\n 9000\n \n \n \n \n \n true\n \n node_1\n 9000\n \n \n node_2\n 9000\n \n \n \n \n\n' > /etc/clickhouse-server/config.d/remote_servers.xml"] Command:[docker exec roottestreloadclustersconfig-gw7-node-1 bash -c echo ' true node_1 9000 node_2 9000 true node_1 9000 node_2 9000 ' > /etc/clickhouse-server/config.d/remote_servers.xml] Command:[docker exec roottestreloadclustersconfig-gw7-node-1 bash -c echo ' true node_1 9000 node_2 9000 true node_1 9000 node_2 9000 ' > /etc/clickhouse-server/config.d/remote_servers.xml] Executing query SYSTEM RELOAD CONFIG on node Executing query SYSTEM RELOAD CONFIG on node [gw7] PASSED test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_simple_reload Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Connection dropped: socket connection error: None Connection dropped: socket connection error: None Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Connection dropped: socket connection error: None Connection dropped: socket connection error: None Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: azurite1 Pulling Stderr: azurite1 Pulling Stderr: resolver Pulling Stderr: resolver Pulling Stderr: minio1 Pulling Stderr: minio1 Pulling Stderr: proxy1 Pulling Stderr: proxy1 Pulling Stderr: node Pulling Stderr: node Pulling Stderr: node Pulled Stderr: node Pulled Stderr: proxy1 Pulled Stderr: proxy1 Pulled Stderr: minio1 Pulled Stderr: minio1 Pulled Stderr: resolver Pulled Stderr: resolver Pulled Stderr: f18232174bc9 Pulling fs layer Stderr: f18232174bc9 Pulling fs layer Stderr: cb2bde55f71f Pulling fs layer Stderr: cb2bde55f71f Pulling fs layer Stderr: 9d0e0719fbe0 Pulling fs layer Stderr: 9d0e0719fbe0 Pulling fs layer Stderr: 6f063dbd7a5d Pulling fs layer Stderr: 6f063dbd7a5d Pulling fs layer Stderr: f9e3e3d8f042 Pulling fs layer Stderr: f9e3e3d8f042 Pulling fs layer Stderr: a39ef2f62dc8 Pulling fs layer Stderr: a39ef2f62dc8 Pulling fs layer Stderr: 9a21c6b23f0e Pulling fs layer Stderr: 9a21c6b23f0e Pulling fs layer Stderr: efeb7b313b67 Pulling fs layer Stderr: efeb7b313b67 Pulling fs layer Stderr: 6fef65209747 Pulling fs layer Stderr: 6fef65209747 Pulling fs layer Stderr: 3d377e512a83 Pulling fs layer Stderr: 3d377e512a83 Pulling fs layer Stderr: efeb7b313b67 Waiting Stderr: efeb7b313b67 Waiting Stderr: f9e3e3d8f042 Waiting Stderr: f9e3e3d8f042 Waiting Stderr: 6fef65209747 Waiting Stderr: 6fef65209747 Waiting Stderr: a39ef2f62dc8 Waiting Stderr: a39ef2f62dc8 Waiting Stderr: 3d377e512a83 Waiting Stderr: 3d377e512a83 Waiting Stderr: 9a21c6b23f0e Waiting Stderr: 9a21c6b23f0e Waiting Stderr: 6f063dbd7a5d Waiting Stderr: 6f063dbd7a5d Waiting Stderr: 9d0e0719fbe0 Downloading [> ] 15.58kB/1.261MB Stderr: 9d0e0719fbe0 Downloading [> ] 15.58kB/1.261MB Stderr: f18232174bc9 Downloading [> ] 48.34kB/3.642MB Stderr: f18232174bc9 Downloading [> ] 48.34kB/3.642MB Stderr: 9d0e0719fbe0 Downloading [==============> ] 375.1kB/1.261MB Stderr: 9d0e0719fbe0 Downloading [==============> ] 375.1kB/1.261MB Stderr: f18232174bc9 Downloading [========> ] 637.2kB/3.642MB Stderr: f18232174bc9 Downloading [========> ] 637.2kB/3.642MB Stderr: cb2bde55f71f Downloading [> ] 506.1kB/50.34MB Stderr: cb2bde55f71f Downloading [> ] 506.1kB/50.34MB Stderr: 9d0e0719fbe0 Verifying Checksum Stderr: 9d0e0719fbe0 Verifying Checksum Stderr: 9d0e0719fbe0 Download complete Stderr: 9d0e0719fbe0 Download complete Stderr: f18232174bc9 Downloading [========================================> ] 2.947MB/3.642MB Stderr: f18232174bc9 Downloading [========================================> ] 2.947MB/3.642MB Stderr: f18232174bc9 Verifying Checksum Stderr: f18232174bc9 Verifying Checksum Stderr: f18232174bc9 Download complete Stderr: f18232174bc9 Download complete Stderr: f18232174bc9 Extracting [> ] 65.54kB/3.642MB Stderr: f18232174bc9 Extracting [> ] 65.54kB/3.642MB Stderr: cb2bde55f71f Downloading [==> ] 2.538MB/50.34MB Stderr: cb2bde55f71f Downloading [==> ] 2.538MB/50.34MB Stderr: f18232174bc9 Extracting [========================> ] 1.769MB/3.642MB Stderr: f18232174bc9 Extracting [========================> ] 1.769MB/3.642MB Stderr: cb2bde55f71f Downloading [=======> ] 7.109MB/50.34MB Stderr: cb2bde55f71f Downloading [=======> ] 7.109MB/50.34MB Stderr: f18232174bc9 Extracting [==================================================>] 3.642MB/3.642MB Stderr: f18232174bc9 Extracting [==================================================>] 3.642MB/3.642MB Stderr: f18232174bc9 Extracting [==================================================>] 3.642MB/3.642MB Stderr: f18232174bc9 Extracting [==================================================>] 3.642MB/3.642MB Stderr: f18232174bc9 Pull complete Stderr: f18232174bc9 Pull complete Stderr: cb2bde55f71f Downloading [================> ] 16.25MB/50.34MB Stderr: cb2bde55f71f Downloading [================> ] 16.25MB/50.34MB Stderr: cb2bde55f71f Downloading [==========================> ] 26.41MB/50.34MB Stderr: cb2bde55f71f Downloading [==========================> ] 26.41MB/50.34MB Stderr: cb2bde55f71f Downloading [=======================================> ] 40.12MB/50.34MB Stderr: cb2bde55f71f Downloading [=======================================> ] 40.12MB/50.34MB Stderr: cb2bde55f71f Verifying Checksum Stderr: cb2bde55f71f Verifying Checksum Stderr: cb2bde55f71f Download complete Stderr: cb2bde55f71f Download complete Stderr: cb2bde55f71f Extracting [> ] 524.3kB/50.34MB Stderr: cb2bde55f71f Extracting [> ] 524.3kB/50.34MB Stderr: cb2bde55f71f Extracting [======> ] 6.816MB/50.34MB Stderr: cb2bde55f71f Extracting [======> ] 6.816MB/50.34MB Stderr: cb2bde55f71f Extracting [===============> ] 15.73MB/50.34MB Stderr: cb2bde55f71f Extracting [===============> ] 15.73MB/50.34MB Stderr: cb2bde55f71f Extracting [=======================> ] 24.12MB/50.34MB Stderr: cb2bde55f71f Extracting [=======================> ] 24.12MB/50.34MB Stderr: cb2bde55f71f Extracting [================================> ] 33.03MB/50.34MB Stderr: cb2bde55f71f Extracting [================================> ] 33.03MB/50.34MB Stderr: cb2bde55f71f Extracting [========================================> ] 40.89MB/50.34MB Stderr: cb2bde55f71f Extracting [========================================> ] 40.89MB/50.34MB Stderr: cb2bde55f71f Extracting [==============================================> ] 46.66MB/50.34MB Stderr: cb2bde55f71f Extracting [==============================================> ] 46.66MB/50.34MB Stderr: cb2bde55f71f Extracting [==============================================> ] 47.19MB/50.34MB Stderr: cb2bde55f71f Extracting [==============================================> ] 47.19MB/50.34MB Stderr: cb2bde55f71f Extracting [===============================================> ] 48.23MB/50.34MB Stderr: cb2bde55f71f Extracting [===============================================> ] 48.23MB/50.34MB Stderr: cb2bde55f71f Extracting [================================================> ] 48.76MB/50.34MB Stderr: cb2bde55f71f Extracting [================================================> ] 48.76MB/50.34MB Stderr: cb2bde55f71f Extracting [=================================================> ] 49.81MB/50.34MB Stderr: cb2bde55f71f Extracting [=================================================> ] 49.81MB/50.34MB Stderr: cb2bde55f71f Extracting [=================================================> ] 50.33MB/50.34MB Stderr: cb2bde55f71f Extracting [=================================================> ] 50.33MB/50.34MB Stderr: cb2bde55f71f Extracting [==================================================>] 50.34MB/50.34MB Stderr: cb2bde55f71f Extracting [==================================================>] 50.34MB/50.34MB Stderr: cb2bde55f71f Pull complete Stderr: cb2bde55f71f Pull complete Stderr: 9d0e0719fbe0 Extracting [=> ] 32.77kB/1.261MB Stderr: 9d0e0719fbe0 Extracting [=> ] 32.77kB/1.261MB Stderr: 9d0e0719fbe0 Extracting [==================================================>] 1.261MB/1.261MB Stderr: 9d0e0719fbe0 Extracting [==================================================>] 1.261MB/1.261MB Stderr: 9d0e0719fbe0 Extracting [==================================================>] 1.261MB/1.261MB Stderr: 9d0e0719fbe0 Extracting [==================================================>] 1.261MB/1.261MB Stderr: 9d0e0719fbe0 Pull complete Stderr: 9d0e0719fbe0 Pull complete Stderr: f9e3e3d8f042 Downloading [==================================================>] 116B/116B Stderr: f9e3e3d8f042 Downloading [==================================================>] 116B/116B Stderr: f9e3e3d8f042 Download complete Stderr: f9e3e3d8f042 Download complete Stderr: a39ef2f62dc8 Downloading [> ] 3.29kB/209.4kB Stderr: a39ef2f62dc8 Downloading [> ] 3.29kB/209.4kB Stderr: 6f063dbd7a5d Downloading [==================================================>] 446B/446B Stderr: 6f063dbd7a5d Downloading [==================================================>] 446B/446B Stderr: 6f063dbd7a5d Verifying Checksum Stderr: 6f063dbd7a5d Verifying Checksum Stderr: 6f063dbd7a5d Download complete Stderr: 6f063dbd7a5d Download complete Stderr: 6f063dbd7a5d Extracting [==================================================>] 446B/446B Stderr: 6f063dbd7a5d Extracting [==================================================>] 446B/446B Stderr: 6f063dbd7a5d Extracting [==================================================>] 446B/446B Stderr: 6f063dbd7a5d Extracting [==================================================>] 446B/446B Stderr: 6f063dbd7a5d Pull complete Stderr: 6f063dbd7a5d Pull complete Stderr: f9e3e3d8f042 Extracting [==================================================>] 116B/116B Stderr: f9e3e3d8f042 Extracting [==================================================>] 116B/116B Stderr: f9e3e3d8f042 Extracting [==================================================>] 116B/116B Stderr: f9e3e3d8f042 Extracting [==================================================>] 116B/116B Stderr: f9e3e3d8f042 Pull complete Stderr: f9e3e3d8f042 Pull complete Stderr: a39ef2f62dc8 Download complete Stderr: a39ef2f62dc8 Download complete Stderr: a39ef2f62dc8 Extracting [=======> ] 32.77kB/209.4kB Stderr: a39ef2f62dc8 Extracting [=======> ] 32.77kB/209.4kB Stderr: a39ef2f62dc8 Extracting [==================================================>] 209.4kB/209.4kB Stderr: a39ef2f62dc8 Extracting [==================================================>] 209.4kB/209.4kB Stderr: a39ef2f62dc8 Extracting [==================================================>] 209.4kB/209.4kB Stderr: a39ef2f62dc8 Extracting [==================================================>] 209.4kB/209.4kB Stderr: a39ef2f62dc8 Pull complete Stderr: a39ef2f62dc8 Pull complete Stderr: 9a21c6b23f0e Downloading [> ] 15.58kB/794kB Stderr: 9a21c6b23f0e Downloading [> ] 15.58kB/794kB Stderr: efeb7b313b67 Downloading [=> ] 15.58kB/458.8kB Stderr: efeb7b313b67 Downloading [=> ] 15.58kB/458.8kB Stderr: 9a21c6b23f0e Downloading [======================> ] 358.7kB/794kB Stderr: 9a21c6b23f0e Downloading [======================> ] 358.7kB/794kB Stderr: efeb7b313b67 Downloading [=======================================> ] 358.7kB/458.8kB Stderr: efeb7b313b67 Downloading [=======================================> ] 358.7kB/458.8kB Stderr: efeb7b313b67 Verifying Checksum Stderr: efeb7b313b67 Verifying Checksum Stderr: efeb7b313b67 Download complete Stderr: efeb7b313b67 Download complete Stderr: 6fef65209747 Downloading [> ] 375.1kB/36.34MB Stderr: 6fef65209747 Downloading [> ] 375.1kB/36.34MB Stderr: 9a21c6b23f0e Downloading [==================================================>] 794kB/794kB Stderr: 9a21c6b23f0e Downloading [==================================================>] 794kB/794kB Stderr: 9a21c6b23f0e Verifying Checksum Stderr: 9a21c6b23f0e Verifying Checksum Stderr: 9a21c6b23f0e Download complete Stderr: 9a21c6b23f0e Download complete Stderr: 9a21c6b23f0e Extracting [==> ] 32.77kB/794kB Stderr: 9a21c6b23f0e Extracting [==> ] 32.77kB/794kB Stderr: 6fef65209747 Downloading [==> ] 1.882MB/36.34MB Stderr: 6fef65209747 Downloading [==> ] 1.882MB/36.34MB Stderr: 9a21c6b23f0e Extracting [============================> ] 458.8kB/794kB Stderr: 9a21c6b23f0e Extracting [============================> ] 458.8kB/794kB Stderr: 6fef65209747 Downloading [========> ] 6.404MB/36.34MB Stderr: 6fef65209747 Downloading [========> ] 6.404MB/36.34MB Stderr: 9a21c6b23f0e Extracting [=============================================> ] 720.9kB/794kB Stderr: 9a21c6b23f0e Extracting [=============================================> ] 720.9kB/794kB Stderr: 9a21c6b23f0e Extracting [==================================================>] 794kB/794kB Stderr: 9a21c6b23f0e Extracting [==================================================>] 794kB/794kB Stderr: 9a21c6b23f0e Pull complete Stderr: 9a21c6b23f0e Pull complete Stderr: efeb7b313b67 Extracting [===> ] 32.77kB/458.8kB Stderr: efeb7b313b67 Extracting [===> ] 32.77kB/458.8kB Stderr: 6fef65209747 Downloading [=====================> ] 15.45MB/36.34MB Stderr: 6fef65209747 Downloading [=====================> ] 15.45MB/36.34MB Stderr: efeb7b313b67 Extracting [==================================================>] 458.8kB/458.8kB Stderr: efeb7b313b67 Extracting [==================================================>] 458.8kB/458.8kB Stderr: efeb7b313b67 Extracting [==================================================>] 458.8kB/458.8kB Stderr: efeb7b313b67 Extracting [==================================================>] 458.8kB/458.8kB Stderr: 6fef65209747 Downloading [=====================================> ] 27.51MB/36.34MB Stderr: 6fef65209747 Downloading [=====================================> ] 27.51MB/36.34MB Stderr: efeb7b313b67 Pull complete Stderr: efeb7b313b67 Pull complete Stderr: 6fef65209747 Verifying Checksum Stderr: 6fef65209747 Verifying Checksum Stderr: 6fef65209747 Download complete Stderr: 6fef65209747 Download complete Stderr: 6fef65209747 Extracting [> ] 393.2kB/36.34MB Stderr: 6fef65209747 Extracting [> ] 393.2kB/36.34MB Stderr: 6fef65209747 Extracting [=> ] 1.18MB/36.34MB Stderr: 6fef65209747 Extracting [=> ] 1.18MB/36.34MB Stderr: 6fef65209747 Extracting [==> ] 1.573MB/36.34MB Stderr: 6fef65209747 Extracting [==> ] 1.573MB/36.34MB Stderr: 6fef65209747 Extracting [===> ] 2.359MB/36.34MB Stderr: 6fef65209747 Extracting [===> ] 2.359MB/36.34MB Stderr: 6fef65209747 Extracting [===> ] 2.753MB/36.34MB Stderr: 6fef65209747 Extracting [===> ] 2.753MB/36.34MB Stderr: 6fef65209747 Extracting [====> ] 3.539MB/36.34MB Stderr: 6fef65209747 Extracting [====> ] 3.539MB/36.34MB Stderr: 6fef65209747 Extracting [=====> ] 3.932MB/36.34MB Stderr: 6fef65209747 Extracting [=====> ] 3.932MB/36.34MB Stderr: 6fef65209747 Extracting [=====> ] 4.325MB/36.34MB Stderr: 6fef65209747 Extracting [=====> ] 4.325MB/36.34MB Stderr: 6fef65209747 Extracting [=======> ] 5.505MB/36.34MB Stderr: 6fef65209747 Extracting [=======> ] 5.505MB/36.34MB Stderr: 6fef65209747 Extracting [========> ] 5.898MB/36.34MB Stderr: 6fef65209747 Extracting [========> ] 5.898MB/36.34MB Stderr: 6fef65209747 Extracting [========> ] 6.291MB/36.34MB Stderr: 6fef65209747 Extracting [========> ] 6.291MB/36.34MB Stderr: 6fef65209747 Extracting [=========> ] 6.685MB/36.34MB Stderr: 6fef65209747 Extracting [=========> ] 6.685MB/36.34MB Stderr: 6fef65209747 Extracting [=========> ] 7.078MB/36.34MB Stderr: 6fef65209747 Extracting [=========> ] 7.078MB/36.34MB Stderr: 6fef65209747 Extracting [==========> ] 7.864MB/36.34MB Stderr: 6fef65209747 Extracting [==========> ] 7.864MB/36.34MB Stderr: 6fef65209747 Extracting [===========> ] 8.258MB/36.34MB Stderr: 6fef65209747 Extracting [===========> ] 8.258MB/36.34MB Stderr: 6fef65209747 Extracting [===========> ] 8.651MB/36.34MB Stderr: 6fef65209747 Extracting [===========> ] 8.651MB/36.34MB Stderr: 6fef65209747 Extracting [============> ] 9.437MB/36.34MB Stderr: 6fef65209747 Extracting [============> ] 9.437MB/36.34MB Stderr: 6fef65209747 Extracting [=============> ] 9.83MB/36.34MB Stderr: 6fef65209747 Extracting [=============> ] 9.83MB/36.34MB Stderr: 6fef65209747 Extracting [=================> ] 12.98MB/36.34MB Stderr: 6fef65209747 Extracting [=================> ] 12.98MB/36.34MB Stderr: 6fef65209747 Extracting [==================> ] 13.76MB/36.34MB Stderr: 6fef65209747 Extracting [==================> ] 13.76MB/36.34MB Stderr: 6fef65209747 Extracting [====================> ] 14.94MB/36.34MB Stderr: 6fef65209747 Extracting [====================> ] 14.94MB/36.34MB Stderr: 6fef65209747 Extracting [=====================> ] 15.34MB/36.34MB Stderr: 6fef65209747 Extracting [=====================> ] 15.34MB/36.34MB Stderr: 6fef65209747 Extracting [=====================> ] 15.73MB/36.34MB Stderr: 6fef65209747 Extracting [=====================> ] 15.73MB/36.34MB Stderr: 6fef65209747 Extracting [======================> ] 16.12MB/36.34MB Stderr: 6fef65209747 Extracting [======================> ] 16.12MB/36.34MB Stderr: 6fef65209747 Extracting [=======================> ] 17.3MB/36.34MB Stderr: 6fef65209747 Extracting [=======================> ] 17.3MB/36.34MB Stderr: 6fef65209747 Extracting [=========================> ] 18.48MB/36.34MB Stderr: 6fef65209747 Extracting [=========================> ] 18.48MB/36.34MB Stderr: 6fef65209747 Extracting [=============================> ] 21.63MB/36.34MB Stderr: 6fef65209747 Extracting [=============================> ] 21.63MB/36.34MB Stderr: 6fef65209747 Extracting [=======================================> ] 28.7MB/36.34MB Stderr: 6fef65209747 Extracting [=======================================> ] 28.7MB/36.34MB Stderr: 6fef65209747 Extracting [==========================================> ] 30.67MB/36.34MB Stderr: 6fef65209747 Extracting [==========================================> ] 30.67MB/36.34MB Stderr: 6fef65209747 Extracting [=================================================> ] 35.78MB/36.34MB Stderr: 6fef65209747 Extracting [=================================================> ] 35.78MB/36.34MB Stderr: 6fef65209747 Extracting [==================================================>] 36.34MB/36.34MB Stderr: 6fef65209747 Extracting [==================================================>] 36.34MB/36.34MB Stderr: 6fef65209747 Pull complete Stderr: 6fef65209747 Pull complete Stderr: 3d377e512a83 Downloading [==================================================>] 2.862kB/2.862kB Stderr: 3d377e512a83 Downloading [==================================================>] 2.862kB/2.862kB Stderr: 3d377e512a83 Verifying Checksum Stderr: 3d377e512a83 Verifying Checksum Stderr: 3d377e512a83 Download complete Stderr: 3d377e512a83 Download complete Stderr: 3d377e512a83 Extracting [==================================================>] 2.862kB/2.862kB Stderr: 3d377e512a83 Extracting [==================================================>] 2.862kB/2.862kB Stderr: 3d377e512a83 Extracting [==================================================>] 2.862kB/2.862kB Stderr: 3d377e512a83 Extracting [==================================================>] 2.862kB/2.862kB Stderr: 3d377e512a83 Pull complete Stderr: 3d377e512a83 Pull complete Stderr: azurite1 Pulled Stderr: azurite1 Pulled Trying to create Minio instance by command docker compose --project-name roottestrestartwithunavailableazure-gw0 --env-file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Trying to create Minio instance by command docker compose --project-name roottestrestartwithunavailableazure-gw0 --env-file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Command:[docker compose --project-name roottestrestartwithunavailableazure-gw0 --env-file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Command:[docker compose --project-name roottestrestartwithunavailableazure-gw0 --env-file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Stderr:time="2025-04-02T02:58:01Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:58:01Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottestrestartwithunavailableazure-gw0_default Creating Stderr: Network roottestrestartwithunavailableazure-gw0_default Creating Stderr: Network roottestrestartwithunavailableazure-gw0_default Created Stderr: Network roottestrestartwithunavailableazure-gw0_default Created Stderr: Volume "roottestrestartwithunavailableazure-gw0_data1-1" Creating Stderr: Volume "roottestrestartwithunavailableazure-gw0_data1-1" Creating Stderr: Volume "roottestrestartwithunavailableazure-gw0_data1-1" Created Stderr: Volume "roottestrestartwithunavailableazure-gw0_data1-1" Created Stderr: Container roottestrestartwithunavailableazure-gw0-proxy2-1 Creating Stderr: Container roottestrestartwithunavailableazure-gw0-proxy2-1 Creating Stderr: Container roottestrestartwithunavailableazure-gw0-proxy1-1 Creating Stderr: Container roottestrestartwithunavailableazure-gw0-proxy1-1 Creating Stderr: Container roottestrestartwithunavailableazure-gw0-proxy1-1 Created Stderr: Container roottestrestartwithunavailableazure-gw0-proxy1-1 Created Stderr: Container roottestrestartwithunavailableazure-gw0-proxy2-1 Created Stderr: Container roottestrestartwithunavailableazure-gw0-proxy2-1 Created Stderr: Container roottestrestartwithunavailableazure-gw0-minio1-1 Creating Stderr: Container roottestrestartwithunavailableazure-gw0-minio1-1 Creating Stderr: Container roottestrestartwithunavailableazure-gw0-resolver-1 Creating Stderr: Container roottestrestartwithunavailableazure-gw0-resolver-1 Creating Stderr: Container roottestrestartwithunavailableazure-gw0-minio1-1 Created Stderr: Container roottestrestartwithunavailableazure-gw0-minio1-1 Created Stderr: Container roottestrestartwithunavailableazure-gw0-resolver-1 Created Stderr: Container roottestrestartwithunavailableazure-gw0-resolver-1 Created Stderr: Container roottestrestartwithunavailableazure-gw0-proxy2-1 Starting Stderr: Container roottestrestartwithunavailableazure-gw0-proxy2-1 Starting Stderr: Container roottestrestartwithunavailableazure-gw0-proxy1-1 Starting Stderr: Container roottestrestartwithunavailableazure-gw0-proxy1-1 Starting Stderr: Container roottestrestartwithunavailableazure-gw0-proxy1-1 Started Stderr: Container roottestrestartwithunavailableazure-gw0-proxy1-1 Started Stderr: Container roottestrestartwithunavailableazure-gw0-proxy2-1 Started Stderr: Container roottestrestartwithunavailableazure-gw0-proxy2-1 Started Stderr: Container roottestrestartwithunavailableazure-gw0-resolver-1 Starting Stderr: Container roottestrestartwithunavailableazure-gw0-resolver-1 Starting Stderr: Container roottestrestartwithunavailableazure-gw0-minio1-1 Starting Stderr: Container roottestrestartwithunavailableazure-gw0-minio1-1 Starting Stderr: Container roottestrestartwithunavailableazure-gw0-minio1-1 Started Stderr: Container roottestrestartwithunavailableazure-gw0-minio1-1 Started Stderr: Container roottestrestartwithunavailableazure-gw0-resolver-1 Started Stderr: Container roottestrestartwithunavailableazure-gw0-resolver-1 Started Stderr:time="2025-04-02T02:58:02Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:58:02Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:58:02Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:58:02Z" level=debug msg="otel error" error="" Trying to connect to Minio... Trying to connect to Minio... get_instance_ip instance_name=minio1 get_instance_ip instance_name=minio1 http://localhost:None "GET /v1.46/containers/roottestrestartwithunavailableazure-gw0-minio1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrestartwithunavailableazure-gw0-minio1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=proxy1 get_instance_ip instance_name=proxy1 http://localhost:None "GET /v1.46/containers/roottestrestartwithunavailableazure-gw0-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrestartwithunavailableazure-gw0-proxy1-1/json HTTP/1.1" 200 None Starting new HTTP connection (1): 172.16.1.4:9001 Starting new HTTP connection (1): 172.16.1.4:9001 Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (2): 172.16.1.4:9001 Starting new HTTP connection (2): 172.16.1.4:9001 Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (3): 172.16.1.4:9001 Starting new HTTP connection (3): 172.16.1.4:9001 Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (4): 172.16.1.4:9001 Starting new HTTP connection (4): 172.16.1.4:9001 Can't connect to Minio: HTTPConnectionPool(host='172.16.1.4', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Can't connect to Minio: HTTPConnectionPool(host='172.16.1.4', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Starting new HTTP connection (5): 172.16.1.4:9001 Starting new HTTP connection (5): 172.16.1.4:9001 http://172.16.1.4:9001 "GET / HTTP/1.1" 200 0 http://172.16.1.4:9001 "GET / HTTP/1.1" 200 0 Connected to Minio. Connected to Minio. http://172.16.1.4:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.1.4:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.1.4:9001 "PUT /root HTTP/1.1" 200 0 http://172.16.1.4:9001 "PUT /root HTTP/1.1" 200 0 S3 bucket 'root' created S3 bucket 'root' created http://172.16.1.4:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.1.4:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.1.4:9001 "PUT /root2 HTTP/1.1" 200 0 http://172.16.1.4:9001 "PUT /root2 HTTP/1.1" 200 0 S3 bucket 'root2' created S3 bucket 'root2' created Trying to create Azurite instance by command docker compose --project-name roottestrestartwithunavailableazure-gw0 --env-file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml --verbose up -d Trying to create Azurite instance by command docker compose --project-name roottestrestartwithunavailableazure-gw0 --env-file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml --verbose up -d Command:[docker compose --project-name roottestrestartwithunavailableazure-gw0 --env-file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml --verbose up -d] Command:[docker compose --project-name roottestrestartwithunavailableazure-gw0 --env-file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml --verbose up -d] Stderr:time="2025-04-02T02:58:03Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:58:03Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:58:03Z" level=warning msg="Found orphan containers ([roottestrestartwithunavailableazure-gw0-minio1-1 roottestrestartwithunavailableazure-gw0-resolver-1 roottestrestartwithunavailableazure-gw0-proxy2-1 roottestrestartwithunavailableazure-gw0-proxy1-1]) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up." Stderr:time="2025-04-02T02:58:03Z" level=warning msg="Found orphan containers ([roottestrestartwithunavailableazure-gw0-minio1-1 roottestrestartwithunavailableazure-gw0-resolver-1 roottestrestartwithunavailableazure-gw0-proxy2-1 roottestrestartwithunavailableazure-gw0-proxy1-1]) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up." Stderr: Container roottestrestartwithunavailableazure-gw0-azurite1-1 Creating Stderr: Container roottestrestartwithunavailableazure-gw0-azurite1-1 Creating Stderr: Container roottestrestartwithunavailableazure-gw0-azurite1-1 Created Stderr: Container roottestrestartwithunavailableazure-gw0-azurite1-1 Created Stderr: Container roottestrestartwithunavailableazure-gw0-azurite1-1 Starting Stderr: Container roottestrestartwithunavailableazure-gw0-azurite1-1 Starting Stderr: Container roottestrestartwithunavailableazure-gw0-azurite1-1 Started Stderr: Container roottestrestartwithunavailableazure-gw0-azurite1-1 Started Stderr:time="2025-04-02T02:58:04Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:58:04Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:58:04Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:58:04Z" level=debug msg="otel error" error="" Trying to connect to Azurite Trying to connect to Azurite Request URL: 'http://127.0.0.1:30000/devstoreaccount1/?restype=REDACTED&comp=REDACTED' Request method: 'GET' Request headers: 'x-ms-version': 'REDACTED' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '4c7ddd16-0f6e-11f0-b6f2-0242ac110002' 'Authorization': 'REDACTED' No body was attached to the request Request URL: 'http://127.0.0.1:30000/devstoreaccount1/?restype=REDACTED&comp=REDACTED' Request method: 'GET' Request headers: 'x-ms-version': 'REDACTED' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '4c7ddd16-0f6e-11f0-b6f2-0242ac110002' 'Authorization': 'REDACTED' No body was attached to the request Starting new HTTP connection (1): 127.0.0.1:30000 Starting new HTTP connection (1): 127.0.0.1:30000 http://127.0.0.1:30000 "GET /devstoreaccount1/?restype=account&comp=properties HTTP/1.1" 200 0 http://127.0.0.1:30000 "GET /devstoreaccount1/?restype=account&comp=properties HTTP/1.1" 200 0 Response status: 200 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'x-ms-client-request-id': '4c7ddd16-0f6e-11f0-b6f2-0242ac110002' 'x-ms-request-id': 'e42ea1ed-6a7d-4f21-926a-e00cbaa5ea15' 'x-ms-version': 'REDACTED' 'date': 'Wed, 02 Apr 2025 02:58:05 GMT' 'x-ms-sku-name': 'REDACTED' 'x-ms-account-kind': 'REDACTED' 'x-ms-is-hns-enabled': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' Response status: 200 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'x-ms-client-request-id': '4c7ddd16-0f6e-11f0-b6f2-0242ac110002' 'x-ms-request-id': 'e42ea1ed-6a7d-4f21-926a-e00cbaa5ea15' 'x-ms-version': 'REDACTED' 'date': 'Wed, 02 Apr 2025 02:58:05 GMT' 'x-ms-sku-name': 'REDACTED' 'x-ms-account-kind': 'REDACTED' 'x-ms-is-hns-enabled': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' {'client_request_id': '4c7ddd16-0f6e-11f0-b6f2-0242ac110002', 'request_id': 'e42ea1ed-6a7d-4f21-926a-e00cbaa5ea15', 'version': '2025-05-05', 'date': datetime.datetime(2025, 4, 2, 2, 58, 5, tzinfo=datetime.timezone.utc), 'sku_name': 'Standard_RAGRS', 'account_kind': 'StorageV2', 'is_hns_enabled': False} {'client_request_id': '4c7ddd16-0f6e-11f0-b6f2-0242ac110002', 'request_id': 'e42ea1ed-6a7d-4f21-926a-e00cbaa5ea15', 'version': '2025-05-05', 'date': datetime.datetime(2025, 4, 2, 2, 58, 5, tzinfo=datetime.timezone.utc), 'sku_name': 'Standard_RAGRS', 'account_kind': 'StorageV2', 'is_hns_enabled': False} Request URL: 'http://127.0.0.1:30000/devstoreaccount1/?comp=REDACTED&prefix=REDACTED&include=REDACTED' Request method: 'GET' Request headers: 'x-ms-version': 'REDACTED' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '4c86ca02-0f6e-11f0-b6f2-0242ac110002' 'Authorization': 'REDACTED' No body was attached to the request Request URL: 'http://127.0.0.1:30000/devstoreaccount1/?comp=REDACTED&prefix=REDACTED&include=REDACTED' Request method: 'GET' Request headers: 'x-ms-version': 'REDACTED' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '4c86ca02-0f6e-11f0-b6f2-0242ac110002' 'Authorization': 'REDACTED' No body was attached to the request http://127.0.0.1:30000 "GET /devstoreaccount1/?comp=list&prefix=azurite-container&include= HTTP/1.1" 200 None http://127.0.0.1:30000 "GET /devstoreaccount1/?comp=list&prefix=azurite-container&include= HTTP/1.1" 200 None Response status: 200 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'x-ms-client-request-id': '4c86ca02-0f6e-11f0-b6f2-0242ac110002' 'x-ms-request-id': '8b27a30c-bb04-4697-9ebb-660174f37db5' 'x-ms-version': 'REDACTED' 'content-type': 'application/xml' 'Date': 'Wed, 02 Apr 2025 02:58:05 GMT' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Transfer-Encoding': 'chunked' Response status: 200 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'x-ms-client-request-id': '4c86ca02-0f6e-11f0-b6f2-0242ac110002' 'x-ms-request-id': '8b27a30c-bb04-4697-9ebb-660174f37db5' 'x-ms-version': 'REDACTED' 'content-type': 'application/xml' 'Date': 'Wed, 02 Apr 2025 02:58:05 GMT' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Transfer-Encoding': 'chunked' Request URL: 'http://127.0.0.1:30000/devstoreaccount1/azurite-container?restype=REDACTED' Request method: 'GET' Request headers: 'x-ms-version': 'REDACTED' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '4c88cbea-0f6e-11f0-b6f2-0242ac110002' 'Authorization': 'REDACTED' No body was attached to the request Request URL: 'http://127.0.0.1:30000/devstoreaccount1/azurite-container?restype=REDACTED' Request method: 'GET' Request headers: 'x-ms-version': 'REDACTED' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '4c88cbea-0f6e-11f0-b6f2-0242ac110002' 'Authorization': 'REDACTED' No body was attached to the request Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node http://127.0.0.1:30000 "GET /devstoreaccount1/azurite-container?restype=container HTTP/1.1" 404 None http://127.0.0.1:30000 "GET /devstoreaccount1/azurite-container?restype=container HTTP/1.1" 404 None Response status: 404 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'x-ms-error-code': 'ContainerNotFound' 'x-ms-request-id': '535db798-a028-466b-bd5a-ec76477976c6' 'content-type': 'application/xml' 'Date': 'Wed, 02 Apr 2025 02:58:05 GMT' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Transfer-Encoding': 'chunked' Response status: 404 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'x-ms-error-code': 'ContainerNotFound' 'x-ms-request-id': '535db798-a028-466b-bd5a-ec76477976c6' 'content-type': 'application/xml' 'Date': 'Wed, 02 Apr 2025 02:58:05 GMT' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Transfer-Encoding': 'chunked' azurite container 'azurite-container' doesn't exist, creating it azurite container 'azurite-container' doesn't exist, creating it Request URL: 'http://127.0.0.1:30000/devstoreaccount1/azurite-container?restype=REDACTED' Request method: 'PUT' Request headers: 'x-ms-version': 'REDACTED' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '4c89ecaa-0f6e-11f0-b6f2-0242ac110002' 'Authorization': 'REDACTED' No body was attached to the request Request URL: 'http://127.0.0.1:30000/devstoreaccount1/azurite-container?restype=REDACTED' Request method: 'PUT' Request headers: 'x-ms-version': 'REDACTED' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '4c89ecaa-0f6e-11f0-b6f2-0242ac110002' 'Authorization': 'REDACTED' No body was attached to the request http://127.0.0.1:30000 "PUT /devstoreaccount1/azurite-container?restype=container HTTP/1.1" 201 0 http://127.0.0.1:30000 "PUT /devstoreaccount1/azurite-container?restype=container HTTP/1.1" 201 0 Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x25246BDBD686600"' 'last-modified': 'Wed, 02 Apr 2025 02:58:05 GMT' 'x-ms-client-request-id': '4c89ecaa-0f6e-11f0-b6f2-0242ac110002' 'x-ms-request-id': '6461cffb-47d7-477e-b2d0-7a4b00ad0337' 'x-ms-version': 'REDACTED' 'Date': 'Wed, 02 Apr 2025 02:58:05 GMT' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x25246BDBD686600"' 'last-modified': 'Wed, 02 Apr 2025 02:58:05 GMT' 'x-ms-client-request-id': '4c89ecaa-0f6e-11f0-b6f2-0242ac110002' 'x-ms-request-id': '6461cffb-47d7-477e-b2d0-7a4b00ad0337' 'x-ms-version': 'REDACTED' 'Date': 'Wed, 02 Apr 2025 02:58:05 GMT' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/.env --project-name roottestrestartwithunavailableazure-gw0 --file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/.env --project-name roottestrestartwithunavailableazure-gw0 --file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/.env --project-name roottestrestartwithunavailableazure-gw0 --file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/.env --project-name roottestrestartwithunavailableazure-gw0 --file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml up -d --no-recreate] Stderr: Container roottestrestartwithunavailableazure-gw0-proxy1-1 Running Stderr: Container roottestrestartwithunavailableazure-gw0-proxy1-1 Running Stderr: Container roottestrestartwithunavailableazure-gw0-proxy2-1 Running Stderr: Container roottestrestartwithunavailableazure-gw0-proxy2-1 Running Stderr: Container roottestrestartwithunavailableazure-gw0-azurite1-1 Running Stderr: Container roottestrestartwithunavailableazure-gw0-azurite1-1 Running Stderr: Container roottestrestartwithunavailableazure-gw0-resolver-1 Running Stderr: Container roottestrestartwithunavailableazure-gw0-resolver-1 Running Stderr: Container roottestrestartwithunavailableazure-gw0-minio1-1 Running Stderr: Container roottestrestartwithunavailableazure-gw0-minio1-1 Running Stderr: Container roottestrestartwithunavailableazure-gw0-node-1 Creating Stderr: Container roottestrestartwithunavailableazure-gw0-node-1 Creating Stderr: Container roottestrestartwithunavailableazure-gw0-node-1 Created Stderr: Container roottestrestartwithunavailableazure-gw0-node-1 Created Stderr: Container roottestrestartwithunavailableazure-gw0-node-1 Starting Stderr: Container roottestrestartwithunavailableazure-gw0-node-1 Starting Stderr: Container roottestrestartwithunavailableazure-gw0-node-1 Started Stderr: Container roottestrestartwithunavailableazure-gw0-node-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottestrestartwithunavailableazure-gw0-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrestartwithunavailableazure-gw0-node-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottestrestartwithunavailableazure-gw0-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrestartwithunavailableazure-gw0-node-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node, ip: 172.16.1.7... Waiting for ClickHouse start in node, ip: 172.16.1.7... http://localhost:None "GET /v1.46/containers/roottestrestartwithunavailableazure-gw0-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrestartwithunavailableazure-gw0-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/b36292535df34aab2b12f4d9b449c122cee3c41f021c34da91b7122bb85355cb/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/b36292535df34aab2b12f4d9b449c122cee3c41f021c34da91b7122bb85355cb/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/b36292535df34aab2b12f4d9b449c122cee3c41f021c34da91b7122bb85355cb/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/b36292535df34aab2b12f4d9b449c122cee3c41f021c34da91b7122bb85355cb/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/b36292535df34aab2b12f4d9b449c122cee3c41f021c34da91b7122bb85355cb/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/b36292535df34aab2b12f4d9b449c122cee3c41f021c34da91b7122bb85355cb/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/b36292535df34aab2b12f4d9b449c122cee3c41f021c34da91b7122bb85355cb/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/b36292535df34aab2b12f4d9b449c122cee3c41f021c34da91b7122bb85355cb/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/b36292535df34aab2b12f4d9b449c122cee3c41f021c34da91b7122bb85355cb/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/b36292535df34aab2b12f4d9b449c122cee3c41f021c34da91b7122bb85355cb/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/b36292535df34aab2b12f4d9b449c122cee3c41f021c34da91b7122bb85355cb/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/b36292535df34aab2b12f4d9b449c122cee3c41f021c34da91b7122bb85355cb/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/b36292535df34aab2b12f4d9b449c122cee3c41f021c34da91b7122bb85355cb/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/b36292535df34aab2b12f4d9b449c122cee3c41f021c34da91b7122bb85355cb/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/b36292535df34aab2b12f4d9b449c122cee3c41f021c34da91b7122bb85355cb/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/b36292535df34aab2b12f4d9b449c122cee3c41f021c34da91b7122bb85355cb/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/b36292535df34aab2b12f4d9b449c122cee3c41f021c34da91b7122bb85355cb/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/b36292535df34aab2b12f4d9b449c122cee3c41f021c34da91b7122bb85355cb/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/b36292535df34aab2b12f4d9b449c122cee3c41f021c34da91b7122bb85355cb/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/b36292535df34aab2b12f4d9b449c122cee3c41f021c34da91b7122bb85355cb/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/b36292535df34aab2b12f4d9b449c122cee3c41f021c34da91b7122bb85355cb/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/b36292535df34aab2b12f4d9b449c122cee3c41f021c34da91b7122bb85355cb/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/b36292535df34aab2b12f4d9b449c122cee3c41f021c34da91b7122bb85355cb/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/b36292535df34aab2b12f4d9b449c122cee3c41f021c34da91b7122bb85355cb/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/b36292535df34aab2b12f4d9b449c122cee3c41f021c34da91b7122bb85355cb/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/b36292535df34aab2b12f4d9b449c122cee3c41f021c34da91b7122bb85355cb/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/b36292535df34aab2b12f4d9b449c122cee3c41f021c34da91b7122bb85355cb/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/b36292535df34aab2b12f4d9b449c122cee3c41f021c34da91b7122bb85355cb/json HTTP/1.1" 200 None ClickHouse node started ClickHouse node started Starting custom Azure endpoint Starting custom Azure endpoint Starting mock server endpoint.py Starting mock server endpoint.py run container_id:roottestrestartwithunavailableazure-gw0-resolver-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname endpoint.py) && echo IyEvdXNyL2Jpbi9lbnYgcHl0aG9uMwpmcm9tIGJvdHRsZSBpbXBvcnQgcmVxdWVzdCwgcmVzcG9uc2UsIHJvdXRlLCBydW4KCgpAcm91dGUoIi88X2J1Y2tldD4vPF9wYXRoOnBhdGg+IiwgWyJHRVQiLCAiUE9TVCIsICJQVVQiLCAiREVMRVRFIl0pCmRlZiBzZXJ2ZXIoX2J1Y2tldCwgX3BhdGgpOgogICAgcmVzcG9uc2Uuc3RhdHVzID0gNDAzCiAgICByZXR1cm4gIkZvcmJpZGRlbiIKCgpAcm91dGUoIi8iKQpkZWYgcGluZygpOgogICAgcmV0dXJuICJPSyIKCgpydW4oaG9zdD0iMC4wLjAuMCIsIHBvcnQ9ODA4MCkK | base64 --decode > endpoint.py'] run container_id:roottestrestartwithunavailableazure-gw0-resolver-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname endpoint.py) && echo IyEvdXNyL2Jpbi9lbnYgcHl0aG9uMwpmcm9tIGJvdHRsZSBpbXBvcnQgcmVxdWVzdCwgcmVzcG9uc2UsIHJvdXRlLCBydW4KCgpAcm91dGUoIi88X2J1Y2tldD4vPF9wYXRoOnBhdGg+IiwgWyJHRVQiLCAiUE9TVCIsICJQVVQiLCAiREVMRVRFIl0pCmRlZiBzZXJ2ZXIoX2J1Y2tldCwgX3BhdGgpOgogICAgcmVzcG9uc2Uuc3RhdHVzID0gNDAzCiAgICByZXR1cm4gIkZvcmJpZGRlbiIKCgpAcm91dGUoIi8iKQpkZWYgcGluZygpOgogICAgcmV0dXJuICJPSyIKCgpydW4oaG9zdD0iMC4wLjAuMCIsIHBvcnQ9ODA4MCkK | base64 --decode > endpoint.py'] Command:[docker exec roottestrestartwithunavailableazure-gw0-resolver-1 bash -c mkdir -p $(dirname endpoint.py) && echo IyEvdXNyL2Jpbi9lbnYgcHl0aG9uMwpmcm9tIGJvdHRsZSBpbXBvcnQgcmVxdWVzdCwgcmVzcG9uc2UsIHJvdXRlLCBydW4KCgpAcm91dGUoIi88X2J1Y2tldD4vPF9wYXRoOnBhdGg+IiwgWyJHRVQiLCAiUE9TVCIsICJQVVQiLCAiREVMRVRFIl0pCmRlZiBzZXJ2ZXIoX2J1Y2tldCwgX3BhdGgpOgogICAgcmVzcG9uc2Uuc3RhdHVzID0gNDAzCiAgICByZXR1cm4gIkZvcmJpZGRlbiIKCgpAcm91dGUoIi8iKQpkZWYgcGluZygpOgogICAgcmV0dXJuICJPSyIKCgpydW4oaG9zdD0iMC4wLjAuMCIsIHBvcnQ9ODA4MCkK | base64 --decode > endpoint.py] Command:[docker exec roottestrestartwithunavailableazure-gw0-resolver-1 bash -c mkdir -p $(dirname endpoint.py) && echo IyEvdXNyL2Jpbi9lbnYgcHl0aG9uMwpmcm9tIGJvdHRsZSBpbXBvcnQgcmVxdWVzdCwgcmVzcG9uc2UsIHJvdXRlLCBydW4KCgpAcm91dGUoIi88X2J1Y2tldD4vPF9wYXRoOnBhdGg+IiwgWyJHRVQiLCAiUE9TVCIsICJQVVQiLCAiREVMRVRFIl0pCmRlZiBzZXJ2ZXIoX2J1Y2tldCwgX3BhdGgpOgogICAgcmVzcG9uc2Uuc3RhdHVzID0gNDAzCiAgICByZXR1cm4gIkZvcmJpZGRlbiIKCgpAcm91dGUoIi8iKQpkZWYgcGluZygpOgogICAgcmV0dXJuICJPSyIKCgpydW4oaG9zdD0iMC4wLjAuMCIsIHBvcnQ9ODA4MCkK | base64 --decode > endpoint.py] run container_id:roottestrestartwithunavailableazure-gw0-resolver-1 detach:True nothrow:False cmd: ['bash', '-c', 'python3 endpoint.py 8080 >/var/log/resolver/endpoint.log 2>/var/log/resolver/endpoint.err.log'] run container_id:roottestrestartwithunavailableazure-gw0-resolver-1 detach:True nothrow:False cmd: ['bash', '-c', 'python3 endpoint.py 8080 >/var/log/resolver/endpoint.log 2>/var/log/resolver/endpoint.err.log'] Command:[docker exec roottestrestartwithunavailableazure-gw0-resolver-1 bash -c python3 endpoint.py 8080 >/var/log/resolver/endpoint.log 2>/var/log/resolver/endpoint.err.log] Command:[docker exec roottestrestartwithunavailableazure-gw0-resolver-1 bash -c python3 endpoint.py 8080 >/var/log/resolver/endpoint.log 2>/var/log/resolver/endpoint.err.log] run container_id:roottestrestartwithunavailableazure-gw0-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8080/'] run container_id:roottestrestartwithunavailableazure-gw0-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8080/'] Command:[docker exec roottestrestartwithunavailableazure-gw0-resolver-1 curl -s http://localhost:8080/] Command:[docker exec roottestrestartwithunavailableazure-gw0-resolver-1 curl -s http://localhost:8080/] Exitcode:7 Exitcode:7 run container_id:roottestrestartwithunavailableazure-gw0-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8080/'] run container_id:roottestrestartwithunavailableazure-gw0-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8080/'] Command:[docker exec roottestrestartwithunavailableazure-gw0-resolver-1 curl -s http://localhost:8080/] Command:[docker exec roottestrestartwithunavailableazure-gw0-resolver-1 curl -s http://localhost:8080/] Stdout:OK Stdout:OK endpoint.py answered OK on attempt 2 endpoint.py answered OK on attempt 2 Mock server endpoint.py started Mock server endpoint.py started Azure endpoint started Azure endpoint started Executing query CREATE TABLE test_table (a UInt64, b String) ENGINE = AzureBlobStorage('DefaultEndpointsProtocol=http;AccountName=devstoreaccount1;AccountKey=Eby8vdM02xNOcqFlqUwJPLlmEtlCDXJ1OUzFT50uSRZ6IFsuFq2UVErCz4I6tq/K1SZFPTOtr/KBHBeksoGMGw==;BlobEndpoint=http://azurite1:30000/devstoreaccount1;', 'cont', 'test_table.csv', 'CSV') ORDER BY tuple() on node Executing query CREATE TABLE test_table (a UInt64, b String) ENGINE = AzureBlobStorage('DefaultEndpointsProtocol=http;AccountName=devstoreaccount1;AccountKey=Eby8vdM02xNOcqFlqUwJPLlmEtlCDXJ1OUzFT50uSRZ6IFsuFq2UVErCz4I6tq/K1SZFPTOtr/KBHBeksoGMGw==;BlobEndpoint=http://azurite1:30000/devstoreaccount1;', 'cont', 'test_table.csv', 'CSV') ORDER BY tuple() on node run container_id:roottestrestartwithunavailableazure-gw0-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] run container_id:roottestrestartwithunavailableazure-gw0-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] Command:[docker exec -u root roottestrestartwithunavailableazure-gw0-node-1 bash -c ps -C clickhouse] Command:[docker exec -u root roottestrestartwithunavailableazure-gw0-node-1 bash -c ps -C clickhouse] Stdout: PID TTY TIME CMD Stdout: PID TTY TIME CMD Stdout: 8 ? 00:00:01 clickhouse Stdout: 8 ? 00:00:01 clickhouse run container_id:roottestrestartwithunavailableazure-gw0-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] run container_id:roottestrestartwithunavailableazure-gw0-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] Command:[docker exec -u root roottestrestartwithunavailableazure-gw0-node-1 bash -c pkill clickhouse] Command:[docker exec -u root roottestrestartwithunavailableazure-gw0-node-1 bash -c pkill clickhouse] run container_id:roottestrestartwithunavailableazure-gw0-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrestartwithunavailableazure-gw0-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrestartwithunavailableazure-gw0-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrestartwithunavailableazure-gw0-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:8 Stdout:8 run container_id:roottestrestartwithunavailableazure-gw0-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrestartwithunavailableazure-gw0-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrestartwithunavailableazure-gw0-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrestartwithunavailableazure-gw0-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:8 Stdout:8 run container_id:roottestrestartwithunavailableazure-gw0-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrestartwithunavailableazure-gw0-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrestartwithunavailableazure-gw0-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrestartwithunavailableazure-gw0-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:8 Stdout:8 run container_id:roottestrestartwithunavailableazure-gw0-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrestartwithunavailableazure-gw0-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrestartwithunavailableazure-gw0-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrestartwithunavailableazure-gw0-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:8 Stdout:8 run container_id:roottestrestartwithunavailableazure-gw0-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrestartwithunavailableazure-gw0-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrestartwithunavailableazure-gw0-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrestartwithunavailableazure-gw0-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] run container_id:roottestrestartwithunavailableazure-gw0-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's|azurite1:30000|resolver:8080|g' /var/lib/clickhouse/metadata/default/test_table.sql"] run container_id:roottestrestartwithunavailableazure-gw0-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's|azurite1:30000|resolver:8080|g' /var/lib/clickhouse/metadata/default/test_table.sql"] Command:[docker exec roottestrestartwithunavailableazure-gw0-node-1 bash -c sed -i 's|azurite1:30000|resolver:8080|g' /var/lib/clickhouse/metadata/default/test_table.sql] Command:[docker exec roottestrestartwithunavailableazure-gw0-node-1 bash -c sed -i 's|azurite1:30000|resolver:8080|g' /var/lib/clickhouse/metadata/default/test_table.sql] run container_id:roottestrestartwithunavailableazure-gw0-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrestartwithunavailableazure-gw0-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrestartwithunavailableazure-gw0-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrestartwithunavailableazure-gw0-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] No clickhouse process running. Start new one. No clickhouse process running. Start new one. http://localhost:None "POST /v1.46/containers/roottestrestartwithunavailableazure-gw0-node-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/roottestrestartwithunavailableazure-gw0-node-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/48b0903c0d75c393bfc40aa423066aaade5b1b3810505360f45eac83a07b02a3/start HTTP/1.1" 200 0 http://localhost:None "POST /v1.46/exec/48b0903c0d75c393bfc40aa423066aaade5b1b3810505360f45eac83a07b02a3/start HTTP/1.1" 200 0 http://localhost:None "GET /v1.46/exec/48b0903c0d75c393bfc40aa423066aaade5b1b3810505360f45eac83a07b02a3/json HTTP/1.1" 200 587 http://localhost:None "GET /v1.46/exec/48b0903c0d75c393bfc40aa423066aaade5b1b3810505360f45eac83a07b02a3/json HTTP/1.1" 200 587 run container_id:roottestrestartwithunavailableazure-gw0-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrestartwithunavailableazure-gw0-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrestartwithunavailableazure-gw0-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrestartwithunavailableazure-gw0-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:771 Stdout:771 Clickhouse process running. Clickhouse process running. run container_id:roottestrestartwithunavailableazure-gw0-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrestartwithunavailableazure-gw0-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrestartwithunavailableazure-gw0-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrestartwithunavailableazure-gw0-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:771 Stdout:771 Executing query select 20 on node Executing query select 20 on node Executing query select 20 on node Executing query select 20 on node Executing query DROP TABLE test_table on node Executing query DROP TABLE test_table on node Command:[docker compose --env-file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/.env --project-name roottestrestartwithunavailableazure-gw0 --file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/.env --project-name roottestrestartwithunavailableazure-gw0 --file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml stop --timeout 20] [gw0] PASSED test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Connection dropped: socket connection error: None Connection dropped: socket connection error: None Connection dropped: socket connection error: None Connection dropped: socket connection error: None Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Stderr: Container roottestrestartwithunavailableazure-gw0-node-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw0-node-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw0-resolver-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw0-resolver-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw0-node-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw0-node-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw0-azurite1-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw0-azurite1-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw0-minio1-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw0-minio1-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw0-minio1-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw0-minio1-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw0-azurite1-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw0-azurite1-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw0-resolver-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw0-resolver-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw0-proxy2-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw0-proxy2-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw0-proxy1-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw0-proxy1-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw0-proxy2-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw0-proxy2-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw0-proxy1-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw0-proxy1-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/.env --project-name roottestrestartwithunavailableazure-gw0 --file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/.env --project-name roottestrestartwithunavailableazure-gw0 --file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw0/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml down --volumes] Stderr: Container roottestrestartwithunavailableazure-gw0-node-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw0-node-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw0-resolver-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw0-resolver-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw0-node-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw0-node-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw0-node-1 Removing Stderr: Container roottestrestartwithunavailableazure-gw0-node-1 Removing Stderr: Container roottestrestartwithunavailableazure-gw0-resolver-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw0-resolver-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw0-resolver-1 Removing Stderr: Container roottestrestartwithunavailableazure-gw0-resolver-1 Removing Stderr: Container roottestrestartwithunavailableazure-gw0-node-1 Removed Stderr: Container roottestrestartwithunavailableazure-gw0-node-1 Removed Stderr: Container roottestrestartwithunavailableazure-gw0-azurite1-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw0-azurite1-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw0-minio1-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw0-minio1-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw0-minio1-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw0-minio1-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw0-minio1-1 Removing Stderr: Container roottestrestartwithunavailableazure-gw0-minio1-1 Removing Stderr: Container roottestrestartwithunavailableazure-gw0-azurite1-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw0-azurite1-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw0-azurite1-1 Removing Stderr: Container roottestrestartwithunavailableazure-gw0-azurite1-1 Removing Stderr: Container roottestrestartwithunavailableazure-gw0-resolver-1 Removed Stderr: Container roottestrestartwithunavailableazure-gw0-resolver-1 Removed Stderr: Container roottestrestartwithunavailableazure-gw0-azurite1-1 Removed Stderr: Container roottestrestartwithunavailableazure-gw0-azurite1-1 Removed Stderr: Container roottestrestartwithunavailableazure-gw0-minio1-1 Removed Stderr: Container roottestrestartwithunavailableazure-gw0-minio1-1 Removed Stderr: Container roottestrestartwithunavailableazure-gw0-proxy1-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw0-proxy1-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw0-proxy2-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw0-proxy2-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw0-proxy1-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw0-proxy1-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw0-proxy1-1 Removing Stderr: Container roottestrestartwithunavailableazure-gw0-proxy1-1 Removing Stderr: Container roottestrestartwithunavailableazure-gw0-proxy2-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw0-proxy2-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw0-proxy2-1 Removing Stderr: Container roottestrestartwithunavailableazure-gw0-proxy2-1 Removing Stderr: Container roottestrestartwithunavailableazure-gw0-proxy2-1 Removed Stderr: Container roottestrestartwithunavailableazure-gw0-proxy2-1 Removed Stderr: Container roottestrestartwithunavailableazure-gw0-proxy1-1 Removed Stderr: Container roottestrestartwithunavailableazure-gw0-proxy1-1 Removed Stderr: Volume roottestrestartwithunavailableazure-gw0_data1-1 Removing Stderr: Volume roottestrestartwithunavailableazure-gw0_data1-1 Removing Stderr: Network roottestrestartwithunavailableazure-gw0_default Removing Stderr: Network roottestrestartwithunavailableazure-gw0_default Removing Stderr: Volume roottestrestartwithunavailableazure-gw0_data1-1 Removed Stderr: Volume roottestrestartwithunavailableazure-gw0_data1-1 Removed Stderr: Network roottestrestartwithunavailableazure-gw0_default Removed Stderr: Network roottestrestartwithunavailableazure-gw0_default Removed Cleanup called Cleanup called Docker networks for project roottestrestartwithunavailableazure-gw0 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestrestartwithunavailableazure-gw0 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestrestartwithunavailableazure-gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestrestartwithunavailableazure-gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestrestartwithunavailableazure-gw0 are DRIVER VOLUME NAME Docker volumes for project roottestrestartwithunavailableazure-gw0 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestrestartwithunavailableazure-gw0-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestrestartwithunavailableazure-gw0-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestrestartwithunavailableazure-gw0 No running containers for project: roottestrestartwithunavailableazure-gw0 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:1 Stdout:1 Volumes pruned: 1 Volumes pruned: 1 Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster' and host_name='node_1' on node Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster' and host_name='node_1' on node Executing query SYSTEM RELOAD CONFIG on node Executing query SYSTEM RELOAD CONFIG on node Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster' and host_name='node_1' on node Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster' and host_name='node_1' on node [gw7] PASSED test_reload_clusters_config/test.py::test_simple_reload test_reload_clusters_config/test.py::test_update_one_cluster Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Connection dropped: socket connection error: None Connection dropped: socket connection error: None Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Connection dropped: socket connection error: None Connection dropped: socket connection error: None Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Connection dropped: socket connection error: None Connection dropped: socket connection error: None Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Connection dropped: socket connection error: None Connection dropped: socket connection error: None Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Connection dropped: socket connection error: None Connection dropped: socket connection error: None Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Connection dropped: socket connection error: None Connection dropped: socket connection error: None Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster' and host_name='node_1' on node Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster' and host_name='node_1' on node Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/.env --project-name roottestreloadclustersconfig-gw7 --file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/.env --project-name roottestreloadclustersconfig-gw7 --file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop --timeout 20] [gw7] FAILED test_reload_clusters_config/test.py::test_update_one_cluster Connection dropped: socket connection error: None Connection dropped: socket connection error: None Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Stderr: Container roottestreloadclustersconfig-gw7-node-1 Stopping Stderr: Container roottestreloadclustersconfig-gw7-node-1 Stopping Stderr: Container roottestreloadclustersconfig-gw7-node-1 Stopped Stderr: Container roottestreloadclustersconfig-gw7-node-1 Stopped Stderr: Container roottestreloadclustersconfig-gw7-zoo1-1 Stopping Stderr: Container roottestreloadclustersconfig-gw7-zoo1-1 Stopping Stderr: Container roottestreloadclustersconfig-gw7-zoo2-1 Stopping Stderr: Container roottestreloadclustersconfig-gw7-zoo2-1 Stopping Stderr: Container roottestreloadclustersconfig-gw7-zoo3-1 Stopping Stderr: Container roottestreloadclustersconfig-gw7-zoo3-1 Stopping Stderr: Container roottestreloadclustersconfig-gw7-zoo2-1 Stopped Stderr: Container roottestreloadclustersconfig-gw7-zoo2-1 Stopped Stderr: Container roottestreloadclustersconfig-gw7-zoo1-1 Stopped Stderr: Container roottestreloadclustersconfig-gw7-zoo1-1 Stopped Stderr: Container roottestreloadclustersconfig-gw7-zoo3-1 Stopped Stderr: Container roottestreloadclustersconfig-gw7-zoo3-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/.env --project-name roottestreloadclustersconfig-gw7 --file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/.env --project-name roottestreloadclustersconfig-gw7 --file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml down --volumes] Stderr: Container roottestreloadclustersconfig-gw7-node-1 Stopping Stderr: Container roottestreloadclustersconfig-gw7-node-1 Stopping Stderr: Container roottestreloadclustersconfig-gw7-node-1 Stopped Stderr: Container roottestreloadclustersconfig-gw7-node-1 Stopped Stderr: Container roottestreloadclustersconfig-gw7-node-1 Removing Stderr: Container roottestreloadclustersconfig-gw7-node-1 Removing Stderr: Container roottestreloadclustersconfig-gw7-node-1 Removed Stderr: Container roottestreloadclustersconfig-gw7-node-1 Removed Stderr: Container roottestreloadclustersconfig-gw7-zoo2-1 Stopping Stderr: Container roottestreloadclustersconfig-gw7-zoo2-1 Stopping Stderr: Container roottestreloadclustersconfig-gw7-zoo3-1 Stopping Stderr: Container roottestreloadclustersconfig-gw7-zoo3-1 Stopping Stderr: Container roottestreloadclustersconfig-gw7-zoo1-1 Stopping Stderr: Container roottestreloadclustersconfig-gw7-zoo1-1 Stopping Stderr: Container roottestreloadclustersconfig-gw7-zoo2-1 Stopped Stderr: Container roottestreloadclustersconfig-gw7-zoo2-1 Stopped Stderr: Container roottestreloadclustersconfig-gw7-zoo2-1 Removing Stderr: Container roottestreloadclustersconfig-gw7-zoo2-1 Removing Stderr: Container roottestreloadclustersconfig-gw7-zoo3-1 Stopped Stderr: Container roottestreloadclustersconfig-gw7-zoo3-1 Stopped Stderr: Container roottestreloadclustersconfig-gw7-zoo3-1 Removing Stderr: Container roottestreloadclustersconfig-gw7-zoo3-1 Removing Stderr: Container roottestreloadclustersconfig-gw7-zoo1-1 Stopped Stderr: Container roottestreloadclustersconfig-gw7-zoo1-1 Stopped Stderr: Container roottestreloadclustersconfig-gw7-zoo1-1 Removing Stderr: Container roottestreloadclustersconfig-gw7-zoo1-1 Removing Stderr: Container roottestreloadclustersconfig-gw7-zoo2-1 Removed Stderr: Container roottestreloadclustersconfig-gw7-zoo2-1 Removed Stderr: Container roottestreloadclustersconfig-gw7-zoo3-1 Removed Stderr: Container roottestreloadclustersconfig-gw7-zoo3-1 Removed Stderr: Container roottestreloadclustersconfig-gw7-zoo1-1 Removed Stderr: Container roottestreloadclustersconfig-gw7-zoo1-1 Removed Stderr: Network roottestreloadclustersconfig-gw7_default Removing Stderr: Network roottestreloadclustersconfig-gw7_default Removing Stderr: Network roottestreloadclustersconfig-gw7_default Removed Stderr: Network roottestreloadclustersconfig-gw7_default Removed Cleanup called Cleanup called Docker networks for project roottestreloadclustersconfig-gw7 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreloadclustersconfig-gw7 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestreloadclustersconfig-gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreloadclustersconfig-gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreloadclustersconfig-gw7 are DRIVER VOLUME NAME Docker volumes for project roottestreloadclustersconfig-gw7 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestreloadclustersconfig-gw7-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestreloadclustersconfig-gw7-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestreloadclustersconfig-gw7 No running containers for project: roottestreloadclustersconfig-gw7 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:1 Stdout:1 Volumes pruned: 1 Volumes pruned: 1 =================================== FAILURES =================================== ___________________________ test_update_one_cluster ____________________________ [gw7] linux -- Python 3.10.12 /usr/bin/python3 started_cluster = def test_update_one_cluster(started_cluster): send_repeated_query("distributed") send_repeated_query("distributed2") > assert get_errors_count("test_cluster") > 0 E AssertionError: assert 0 > 0 E + where 0 = get_errors_count('test_cluster') test_reload_clusters_config/test.py:202: AssertionError ------------------------------ Captured log call ------------------------------- 2025-04-02 02:58:43 [ 704 ] DEBUG : Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3647, query_and_get_error) 2025-04-02 02:58:55 [ 704 ] DEBUG : Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3647, query_and_get_error) 2025-04-02 02:59:08 [ 704 ] DEBUG : Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3647, query_and_get_error) 2025-04-02 02:59:20 [ 704 ] DEBUG : Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3647, query_and_get_error) 2025-04-02 02:59:35 [ 704 ] DEBUG : Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3647, query_and_get_error) 2025-04-02 02:59:47 [ 704 ] DEBUG : Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3647, query_and_get_error) 2025-04-02 03:00:00 [ 704 ] DEBUG : Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3647, query_and_get_error) 2025-04-02 03:00:12 [ 704 ] DEBUG : Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3647, query_and_get_error) 2025-04-02 03:00:24 [ 704 ] DEBUG : Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3647, query_and_get_error) 2025-04-02 03:00:36 [ 704 ] DEBUG : Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3647, query_and_get_error) 2025-04-02 03:00:49 [ 704 ] DEBUG : Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster' and host_name='node_1' on node (cluster.py:3564, query) ---------------------------- Captured log teardown ----------------------------- 2025-04-02 03:00:49 [ 704 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/.env --project-name roottestreloadclustersconfig-gw7 --file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop --timeout 20] (cluster.py:120, run_and_check) 2025-04-02 03:00:57 [ 704 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw7-node-1 Stopping (cluster.py:146, run_and_check) 2025-04-02 03:00:57 [ 704 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw7-node-1 Stopped (cluster.py:146, run_and_check) 2025-04-02 03:00:57 [ 704 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw7-zoo1-1 Stopping (cluster.py:146, run_and_check) 2025-04-02 03:00:57 [ 704 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw7-zoo2-1 Stopping (cluster.py:146, run_and_check) 2025-04-02 03:00:57 [ 704 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw7-zoo3-1 Stopping (cluster.py:146, run_and_check) 2025-04-02 03:00:57 [ 704 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw7-zoo2-1 Stopped (cluster.py:146, run_and_check) 2025-04-02 03:00:57 [ 704 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw7-zoo1-1 Stopped (cluster.py:146, run_and_check) 2025-04-02 03:00:57 [ 704 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw7-zoo3-1 Stopped (cluster.py:146, run_and_check) 2025-04-02 03:00:57 [ 704 ] DEBUG : Command:[bash -c [ -f /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] (cluster.py:120, run_and_check) 2025-04-02 03:00:57 [ 704 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/.env --project-name roottestreloadclustersconfig-gw7 --file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw7/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml down --volumes] (cluster.py:120, run_and_check) 2025-04-02 03:00:57 [ 704 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw7-node-1 Stopping (cluster.py:146, run_and_check) 2025-04-02 03:00:57 [ 704 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw7-node-1 Stopped (cluster.py:146, run_and_check) 2025-04-02 03:00:57 [ 704 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw7-node-1 Removing (cluster.py:146, run_and_check) 2025-04-02 03:00:57 [ 704 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw7-node-1 Removed (cluster.py:146, run_and_check) 2025-04-02 03:00:57 [ 704 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw7-zoo2-1 Stopping (cluster.py:146, run_and_check) 2025-04-02 03:00:57 [ 704 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw7-zoo3-1 Stopping (cluster.py:146, run_and_check) 2025-04-02 03:00:57 [ 704 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw7-zoo1-1 Stopping (cluster.py:146, run_and_check) 2025-04-02 03:00:57 [ 704 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw7-zoo2-1 Stopped (cluster.py:146, run_and_check) 2025-04-02 03:00:57 [ 704 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw7-zoo2-1 Removing (cluster.py:146, run_and_check) 2025-04-02 03:00:57 [ 704 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw7-zoo3-1 Stopped (cluster.py:146, run_and_check) 2025-04-02 03:00:57 [ 704 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw7-zoo3-1 Removing (cluster.py:146, run_and_check) 2025-04-02 03:00:57 [ 704 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw7-zoo1-1 Stopped (cluster.py:146, run_and_check) 2025-04-02 03:00:57 [ 704 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw7-zoo1-1 Removing (cluster.py:146, run_and_check) 2025-04-02 03:00:57 [ 704 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw7-zoo2-1 Removed (cluster.py:146, run_and_check) 2025-04-02 03:00:57 [ 704 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw7-zoo3-1 Removed (cluster.py:146, run_and_check) 2025-04-02 03:00:57 [ 704 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw7-zoo1-1 Removed (cluster.py:146, run_and_check) 2025-04-02 03:00:57 [ 704 ] DEBUG : Stderr: Network roottestreloadclustersconfig-gw7_default Removing (cluster.py:146, run_and_check) 2025-04-02 03:00:57 [ 704 ] DEBUG : Stderr: Network roottestreloadclustersconfig-gw7_default Removed (cluster.py:146, run_and_check) 2025-04-02 03:00:57 [ 704 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2025-04-02 03:00:57 [ 704 ] DEBUG : Docker networks for project roottestreloadclustersconfig-gw7 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2025-04-02 03:00:57 [ 704 ] DEBUG : Docker containers for project roottestreloadclustersconfig-gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2025-04-02 03:00:57 [ 704 ] DEBUG : Docker volumes for project roottestreloadclustersconfig-gw7 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2025-04-02 03:00:57 [ 704 ] DEBUG : Command:[docker container list --all --filter name='^/roottestreloadclustersconfig-gw7-.*-1$' --format '{{.ID}}:{{.Names}}'] (cluster.py:120, run_and_check) 2025-04-02 03:00:57 [ 704 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2025-04-02 03:00:57 [ 704 ] DEBUG : No running containers for project: roottestreloadclustersconfig-gw7 (cluster.py:904, cleanup) 2025-04-02 03:00:57 [ 704 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2025-04-02 03:00:57 [ 704 ] DEBUG : Trying to prune unused images... (cluster.py:926, cleanup) 2025-04-02 03:00:57 [ 704 ] DEBUG : Command:[docker image prune -f] (cluster.py:120, run_and_check) 2025-04-02 03:00:57 [ 704 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:144, run_and_check) 2025-04-02 03:00:57 [ 704 ] DEBUG : Images pruned (cluster.py:929, cleanup) 2025-04-02 03:00:57 [ 704 ] DEBUG : Trying to prune unused volumes... (cluster.py:935, cleanup) 2025-04-02 03:00:57 [ 704 ] DEBUG : Command:[docker volume ls | wc -l] (cluster.py:120, run_and_check) 2025-04-02 03:00:57 [ 704 ] DEBUG : Stdout:1 (cluster.py:144, run_and_check) 2025-04-02 03:00:57 [ 704 ] DEBUG : Volumes pruned: 1 (cluster.py:940, cleanup) =============================== warnings summary =============================== test_reload_client_certificate/test.py: 33 warnings /usr/local/lib/python3.10/dist-packages/kazoo/handlers/utils.py:225: DeprecationWarning: ssl.PROTOCOL_TLS is deprecated context = ssl.SSLContext(ssl.PROTOCOL_SSLv23) test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries /usr/local/lib/python3.10/dist-packages/_pytest/threadexception.py:73: PytestUnhandledThreadExceptionWarning: Exception in thread Thread-16 (attack) Traceback (most recent call last): File "/usr/lib/python3.10/threading.py", line 1016, in _bootstrap_inner self.run() File "/usr/lib/python3.10/threading.py", line 953, in run self._target(*self._args, **self._kwargs) File "/ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/test.py", line 429, in attack cursor.execute(query_pool[query_id].format(random_table_name)) psycopg2.errors.NumericValueOutOfRange: integer out of range warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg)) -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html ============================== slowest durations =============================== 183.49s call test_reload_client_certificate/test.py::test_wrong_cn_cert 173.29s setup test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart 143.69s call test_reload_clusters_config/test.py::test_add_cluster 134.95s call test_reload_clusters_config/test.py::test_delete_cluster 125.75s call test_reload_clusters_config/test.py::test_update_one_cluster 73.31s call test_replicated_merge_tree_s3_zero_copy/test.py::test_drop_table 63.10s call test_reload_clusters_config/test.py::test_simple_reload 59.79s call test_scheduler/test.py::test_workload_entity_keeper_storage 57.75s call test_replicated_user_defined_functions/test.py::test_reload_zookeeper 57.01s call test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select 38.24s call test_remove_stale_moving_parts/test.py::test_remove_stale_moving_parts_without_zookeeper 38.12s call test_replicated_user_defined_functions/test.py::test_start_without_zookeeper 32.72s teardown test_replicated_merge_tree_s3_zero_copy/test.py::test_s3_check_restore 31.49s call test_scheduler/test.py::test_workload_hierarchy_changes 30.77s setup test_restore_external_engines/test.py::test_restore_table 27.88s call test_reload_client_certificate/test.py::test_correct_cn_cert 25.99s setup test_reload_clusters_config/test.py::test_add_cluster 23.98s setup test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch 23.69s teardown test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 23.55s setup test_scheduler/test.py::test_create_workload 22.94s call test_rocksdb_options/test.py::test_table_invalid_block_based_table_options 22.50s teardown test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns 22.48s teardown test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy_no_proxy 22.05s teardown test_s3_latency_log/test.py::test_latency_log 21.89s teardown test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver] 21.87s call test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries 21.79s setup test_replicated_merge_tree_s3_zero_copy/test.py::test_drop_table 21.78s teardown test_s3_storage_class/test.py::test_s3_storage_class_right 21.73s teardown test_scheduler/test.py::test_workload_hierarchy_changes 21.66s teardown test_s3_imds/test_session_token.py::test_credentials_from_metadata 21.57s teardown test_s3_imds/test_simple.py::test_credentials_from_metadata 21.39s teardown test_remove_stale_moving_parts/test.py::test_remove_stale_moving_parts_without_zookeeper 21.36s teardown test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl 21.34s teardown test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart 21.24s teardown test_s3_storage_conf_new_proxy/test.py::test_s3_with_proxy_list[s3] 20.84s call test_postgresql_replica_database_engine_1/test.py::test_replicating_dml 20.61s call test_rename_column/test.py::test_rename_distributed 20.50s setup test_replicated_user_defined_functions/test.py::test_create_and_drop 20.31s setup test_remove_stale_moving_parts/test.py::test_remove_stale_moving_parts_without_zookeeper 20.12s call test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables 20.05s call test_replicated_merge_tree_compatibility/test.py::test_replicated_merge_tree_defaults_compatibility 19.74s setup test_settings_constraints_distributed/test.py::test_insert_clamps_settings 19.72s call test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished 19.41s setup test_rename_column/test.py::test_rename_distributed 19.29s setup test_reload_client_certificate/test.py::test_correct_cn_cert 19.27s setup test_replicated_merge_tree_compatibility/test.py::test_replicated_merge_tree_defaults_compatibility 19.22s setup test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers 19.10s setup test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_no_proxy 19.09s teardown test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach 18.68s call test_rocksdb_options/test.py::test_table_invalid_column_family_options 18.06s call test_postgresql_replica_database_engine_1/test.py::test_multiple_databases 17.81s setup test_replicated_merge_tree_encrypted_disk/test.py::test_different_keys 17.25s call test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished 17.23s call test_s3_latency_log/test.py::test_latency_log 17.03s setup test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach 16.99s setup test_s3_low_cardinality_right_border/test.py::test_s3_right_border 16.51s setup test_postgresql_replica_database_engine_1/test.py::test_different_data_types 16.23s setup test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3] 15.60s setup test_s3_imds/test_simple.py::test_credentials_from_metadata 15.40s teardown test_reload_client_certificate/test.py::test_wrong_cn_cert 15.15s setup test_s3_storage_conf_new_proxy/test.py::test_s3_with_proxy_list[s3] 15.09s call test_rocksdb_options/test.py::test_invalid_options 15.08s call test_rocksdb_options/test.py::test_invalid_column_family_options 14.49s call test_postgresql_replica_database_engine_1/test.py::test_user_managed_slots 14.11s teardown test_replicated_merge_tree_compatibility/test.py::test_replicated_merge_tree_defaults_compatibility 13.95s call test_scheduler/test.py::test_s3_resource_request_granularity 13.87s call test_rocksdb_options/test.py::test_table_invalid_options 13.51s setup test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl 13.45s setup test_s3_imds/test_session_token.py::test_credentials_from_metadata 13.29s setup test_rocksdb_options/test.py::test_invalid_block_based_table_options 13.01s setup test_s3_storage_class/test.py::test_s3_storage_class_right 12.82s call test_scheduler/test.py::test_create_workload 12.45s call test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers 12.40s call test_postgresql_replica_database_engine_1/test.py::test_single_transaction 12.37s call test_rocksdb_options/test.py::test_invalid_block_based_table_options 12.18s call test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy_no_proxy 12.02s teardown test_rename_column/test.py::test_rename_with_parallel_ttl_move 11.94s call test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy 11.73s call test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list_no_proxy 11.71s call test_replicated_user_defined_functions/test.py::test_server_restart 11.70s call test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_proxy 11.51s call test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver] 11.46s call test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_no_proxy 11.41s call test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list 11.37s call test_s3_storage_conf_new_proxy/test.py::test_s3_with_proxy_list[s3] 11.34s call test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3] 11.16s call test_restore_external_engines/test.py::test_restore_table_null 11.02s call test_restore_external_engines/test.py::test_restore_table 9.23s call test_postgresql_replica_database_engine_1/test.py::test_different_data_types 9.10s call test_postgresql_replica_database_engine_1/test.py::test_table_schema_changes 8.75s teardown test_replicated_merge_tree_encrypted_disk/test.py::test_same_keys 8.35s teardown test_reload_clusters_config/test.py::test_update_one_cluster 7.61s call test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables 7.42s setup test_settings_constraints_distributed/test.py::test_select_clamps_settings 7.19s call test_scheduler/test.py::test_merge_workload_change 6.85s call test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart 6.81s setup test_s3_latency_log/test.py::test_latency_log 6.64s call test_scheduler/test.py::test_mutation_workload_override 6.54s teardown test_restore_external_engines/test.py::test_restore_table_null 6.43s call test_scheduler/test.py::test_mutation_workload_change 6.36s call test_settings_constraints_distributed/test.py::test_select_clamps_settings 6.22s teardown test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers 5.77s setup test_remote_prewhere/test.py::test_remote 5.09s call test_scheduler/test.py::test_resource_read_and_write 4.96s call test_replicated_merge_tree_encrypted_disk/test.py::test_same_keys 4.93s call test_replicated_merge_tree_encrypted_disk/test.py::test_different_keys 4.66s call test_scheduler/test.py::test_merge_workload_override 4.43s teardown test_settings_constraints_distributed/test.py::test_select_clamps_settings 3.89s teardown test_remote_prewhere/test.py::test_remote 3.68s call test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index 3.46s call test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns 3.37s call test_s3_low_cardinality_right_border/test.py::test_s3_right_border 3.33s call test_scheduler/test.py::test_s3_disk 3.32s call test_replicated_merge_tree_s3_zero_copy/test.py::test_s3_check_restore 3.30s call test_replicated_user_defined_functions/test.py::test_replication 3.25s teardown test_replicated_user_defined_functions/test.py::test_start_without_zookeeper 3.21s call test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch 3.02s call test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[8192-12] 2.94s call test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[0-16] 2.65s call test_scheduler/test.py::test_merge_workload 2.56s call test_scheduler/test.py::test_mutate_workload 2.37s call test_settings_constraints_distributed/test.py::test_insert_clamps_settings 2.37s call test_postgresql_replica_database_engine_1/test.py::test_virtual_columns 2.13s call test_postgresql_replica_database_engine_1/test.py::test_quoting_2 2.13s teardown test_postgresql_replica_database_engine_1/test.py::test_virtual_columns 2.06s call test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl 2.05s teardown test_replicated_merge_tree_s3_zero_copy/test.py::test_drop_table 2.04s call test_scheduler/test.py::test_resource_any_disk 2.02s call test_replicated_user_defined_functions/test.py::test_replication_replace_by_another_node_after_creation 2.00s call test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 1.94s call test_postgresql_replica_database_engine_1/test.py::test_quoting_1 1.74s call test_replicated_user_defined_functions/test.py::test_create_and_replace 1.71s setup test_scheduler/test.py::test_resource_read_and_write 1.65s teardown test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[8192-12] 1.60s call test_s3_imds/test_session_token.py::test_credentials_from_metadata 1.59s teardown test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables 1.53s teardown test_postgresql_replica_database_engine_1/test.py::test_multiple_databases 1.53s call test_s3_imds/test_simple.py::test_credentials_from_metadata 1.51s call test_scheduler/test.py::test_throw_on_unknown_workload 1.45s teardown test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[0-16] 1.43s setup test_scheduler/test.py::test_mutation_workload_override 1.42s teardown test_postgresql_replica_database_engine_1/test.py::test_single_transaction 1.33s call test_rocksdb_options/test.py::test_valid_options 1.25s teardown test_rocksdb_options/test.py::test_valid_options 1.10s call test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 1.07s teardown test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables 1.03s setup test_scheduler/test.py::test_merge_workload 1.03s setup test_scheduler/test.py::test_mutation_workload_change 0.98s teardown test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished 0.94s call test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[true-expected_raise0] 0.93s teardown test_postgresql_replica_database_engine_1/test.py::test_quoting_2 0.92s setup test_scheduler/test.py::test_mutate_workload 0.91s teardown test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index 0.90s call test_s3_storage_class/test.py::test_s3_storage_class_right 0.89s teardown test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished 0.89s setup test_scheduler/test.py::test_merge_workload_override 0.88s teardown test_postgresql_replica_database_engine_1/test.py::test_quoting_1 0.87s teardown test_postgresql_replica_database_engine_1/test.py::test_table_schema_changes 0.87s teardown test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries 0.86s teardown test_postgresql_replica_database_engine_1/test.py::test_replicating_dml 0.86s call test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach 0.80s call test_replicated_user_defined_functions/test.py::test_drop_if_exists 0.78s setup test_scheduler/test.py::test_s3_resource_request_granularity 0.76s setup test_scheduler/test.py::test_s3_disk 0.70s call test_replicated_user_defined_functions/test.py::test_create_and_drop 0.70s teardown test_postgresql_replica_database_engine_1/test.py::test_user_managed_slots 0.70s teardown test_postgresql_replica_database_engine_1/test.py::test_different_data_types 0.68s setup test_scheduler/test.py::test_throw_on_unknown_workload 0.64s setup test_scheduler/test.py::test_resource_any_disk 0.63s setup test_scheduler/test.py::test_workload_entity_keeper_storage 0.62s call test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[false-expected_raise1] 0.61s setup test_scheduler/test.py::test_merge_workload_change 0.61s setup test_scheduler/test.py::test_workload_hierarchy_changes 0.42s call test_rename_column/test.py::test_rename_parallel_same_node 0.37s call test_rename_column/test.py::test_rename_with_parallel_slow_insert 0.32s call test_rename_column/test.py::test_rename_with_parallel_ttl_move 0.32s call test_rename_column/test.py::test_rename_with_parallel_merges 0.27s call test_rocksdb_options/test.py::test_valid_column_family_options 0.27s call test_rocksdb_options/test.py::test_table_valid_column_family_options 0.27s call test_remote_prewhere/test.py::test_remote 0.22s call test_rename_column/test.py::test_rename_with_parallel_ttl_delete 0.22s call test_rename_column/test.py::test_rename_with_parallel_select 0.22s call test_rename_column/test.py::test_rename_parallel 0.22s call test_rocksdb_options/test.py::test_table_valid_options 0.22s call test_rename_column/test.py::test_rename_with_parallel_insert 0.01s teardown test_reload_clusters_config/test.py::test_add_cluster 0.01s teardown test_reload_client_certificate/test.py::test_correct_cn_cert 0.01s teardown test_rename_column/test.py::test_rename_distributed 0.00s teardown test_replicated_user_defined_functions/test.py::test_reload_zookeeper 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables 0.00s teardown test_scheduler/test.py::test_create_workload 0.00s setup test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[0-16] 0.00s setup test_replicated_user_defined_functions/test.py::test_replication 0.00s setup test_reload_clusters_config/test.py::test_delete_cluster 0.00s setup test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select 0.00s setup test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy 0.00s teardown test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch 0.00s setup test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy_no_proxy 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries 0.00s teardown test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select 0.00s setup test_rename_column/test.py::test_rename_parallel 0.00s teardown test_scheduler/test.py::test_s3_resource_request_granularity 0.00s setup test_reload_client_certificate/test.py::test_wrong_cn_cert 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_multiple_databases 0.00s teardown test_scheduler/test.py::test_merge_workload_change 0.00s setup test_rocksdb_options/test.py::test_table_invalid_column_family_options 0.00s teardown test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy 0.00s teardown test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list_no_proxy 0.00s setup test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 0.00s teardown test_rocksdb_options/test.py::test_table_invalid_block_based_table_options 0.00s teardown test_scheduler/test.py::test_resource_read_and_write 0.00s setup test_rocksdb_options/test.py::test_table_invalid_options 0.00s setup test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list_no_proxy 0.00s teardown test_rocksdb_options/test.py::test_table_invalid_column_family_options 0.00s setup test_rocksdb_options/test.py::test_table_invalid_block_based_table_options 0.00s setup test_replicated_user_defined_functions/test.py::test_start_without_zookeeper 0.00s setup test_rocksdb_options/test.py::test_invalid_options 0.00s teardown test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3] 0.00s teardown test_rocksdb_options/test.py::test_invalid_options 0.00s setup test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[8192-12] 0.00s setup test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list 0.00s setup test_rename_column/test.py::test_rename_with_parallel_ttl_delete 0.00s teardown test_replicated_merge_tree_encrypted_disk/test.py::test_different_keys 0.00s teardown test_replicated_user_defined_functions/test.py::test_server_restart 0.00s setup test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver] 0.00s teardown test_scheduler/test.py::test_workload_entity_keeper_storage 0.00s teardown test_reload_clusters_config/test.py::test_simple_reload 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished 0.00s teardown test_rocksdb_options/test.py::test_invalid_column_family_options 0.00s teardown test_restore_external_engines/test.py::test_restore_table 0.00s teardown test_reload_clusters_config/test.py::test_delete_cluster 0.00s setup test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[true-expected_raise0] 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_replicating_dml 0.00s teardown test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_no_proxy 0.00s teardown test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list 0.00s setup test_reload_clusters_config/test.py::test_update_one_cluster 0.00s setup test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[false-expected_raise1] 0.00s teardown test_scheduler/test.py::test_merge_workload_override 0.00s teardown test_scheduler/test.py::test_mutation_workload_change 0.00s setup test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns 0.00s setup test_reload_clusters_config/test.py::test_simple_reload 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_quoting_2 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index 0.00s teardown test_replicated_user_defined_functions/test.py::test_create_and_drop 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables 0.00s setup test_rename_column/test.py::test_rename_with_parallel_select 0.00s setup test_rocksdb_options/test.py::test_table_valid_options 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_single_transaction 0.00s teardown test_scheduler/test.py::test_merge_workload 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_quoting_1 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_user_managed_slots 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_table_schema_changes 0.00s setup test_rocksdb_options/test.py::test_valid_options 0.00s setup test_rename_column/test.py::test_rename_with_parallel_slow_insert 0.00s setup test_replicated_user_defined_functions/test.py::test_server_restart 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_virtual_columns 0.00s teardown test_scheduler/test.py::test_mutation_workload_override 0.00s teardown test_settings_constraints_distributed/test.py::test_insert_clamps_settings 0.00s setup test_replicated_user_defined_functions/test.py::test_create_and_replace 0.00s setup test_rename_column/test.py::test_rename_with_parallel_insert 0.00s setup test_rocksdb_options/test.py::test_valid_column_family_options 0.00s teardown test_rocksdb_options/test.py::test_invalid_block_based_table_options 0.00s setup test_restore_external_engines/test.py::test_restore_table_null 0.00s setup test_replicated_merge_tree_s3_zero_copy/test.py::test_s3_check_restore 0.00s setup test_rename_column/test.py::test_rename_with_parallel_merges 0.00s teardown test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[false-expected_raise1] 0.00s teardown test_scheduler/test.py::test_s3_disk 0.00s teardown test_rename_column/test.py::test_rename_parallel 0.00s setup test_rocksdb_options/test.py::test_table_valid_column_family_options 0.00s setup test_replicated_user_defined_functions/test.py::test_replication_replace_by_another_node_after_creation 0.00s setup test_replicated_merge_tree_encrypted_disk/test.py::test_same_keys 0.00s teardown test_rocksdb_options/test.py::test_table_invalid_options 0.00s teardown test_s3_low_cardinality_right_border/test.py::test_s3_right_border 0.00s teardown test_replicated_user_defined_functions/test.py::test_replication_replace_by_another_node_after_creation 0.00s teardown test_rocksdb_options/test.py::test_valid_column_family_options 0.00s teardown test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[true-expected_raise0] 0.00s setup test_rename_column/test.py::test_rename_parallel_same_node 0.00s teardown test_scheduler/test.py::test_resource_any_disk 0.00s teardown test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_proxy 0.00s teardown test_scheduler/test.py::test_mutate_workload 0.00s teardown test_scheduler/test.py::test_throw_on_unknown_workload 0.00s setup test_replicated_user_defined_functions/test.py::test_reload_zookeeper 0.00s teardown test_rocksdb_options/test.py::test_table_valid_options 0.00s setup test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_proxy 0.00s setup test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 0.00s setup test_replicated_user_defined_functions/test.py::test_drop_if_exists 0.00s setup test_rename_column/test.py::test_rename_with_parallel_ttl_move 0.00s setup test_rocksdb_options/test.py::test_invalid_column_family_options 0.00s teardown test_rename_column/test.py::test_rename_parallel_same_node 0.00s teardown test_replicated_user_defined_functions/test.py::test_drop_if_exists 0.00s teardown test_replicated_user_defined_functions/test.py::test_create_and_replace 0.00s teardown test_rocksdb_options/test.py::test_table_valid_column_family_options 0.00s teardown test_rename_column/test.py::test_rename_with_parallel_slow_insert 0.00s teardown test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 0.00s teardown test_rename_column/test.py::test_rename_with_parallel_insert 0.00s teardown test_rename_column/test.py::test_rename_with_parallel_select 0.00s teardown test_replicated_user_defined_functions/test.py::test_replication 0.00s teardown test_rename_column/test.py::test_rename_with_parallel_merges 0.00s teardown test_rename_column/test.py::test_rename_with_parallel_ttl_delete =========================== short test summary info ============================ FAILED test_reload_clusters_config/test.py::test_update_one_cluster - Asserti... PASSED test_s3_low_cardinality_right_border/test.py::test_s3_right_border PASSED test_replicated_user_defined_functions/test.py::test_create_and_drop PASSED test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[false-expected_raise1] PASSED test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 PASSED test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[true-expected_raise0] PASSED test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 PASSED test_replicated_user_defined_functions/test.py::test_create_and_replace PASSED test_replicated_user_defined_functions/test.py::test_drop_if_exists PASSED test_rocksdb_options/test.py::test_invalid_block_based_table_options PASSED test_postgresql_replica_database_engine_1/test.py::test_different_data_types PASSED test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_no_proxy PASSED test_scheduler/test.py::test_create_workload PASSED test_rename_column/test.py::test_rename_distributed PASSED test_scheduler/test.py::test_merge_workload PASSED test_rocksdb_options/test.py::test_invalid_column_family_options PASSED test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_proxy PASSED test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished PASSED test_reload_client_certificate/test.py::test_correct_cn_cert PASSED test_scheduler/test.py::test_merge_workload_change PASSED test_scheduler/test.py::test_merge_workload_override PASSED test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list PASSED test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables PASSED test_rocksdb_options/test.py::test_invalid_options PASSED test_scheduler/test.py::test_mutate_workload PASSED test_scheduler/test.py::test_mutation_workload_change PASSED test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list_no_proxy PASSED test_scheduler/test.py::test_mutation_workload_override PASSED test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch PASSED test_scheduler/test.py::test_resource_any_disk PASSED test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables PASSED test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy PASSED test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns PASSED test_rocksdb_options/test.py::test_table_invalid_block_based_table_options PASSED test_scheduler/test.py::test_resource_read_and_write PASSED test_replicated_user_defined_functions/test.py::test_reload_zookeeper PASSED test_scheduler/test.py::test_s3_disk PASSED test_replicated_user_defined_functions/test.py::test_replication PASSED test_replicated_user_defined_functions/test.py::test_replication_replace_by_another_node_after_creation PASSED test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy_no_proxy PASSED test_replicated_merge_tree_s3_zero_copy/test.py::test_drop_table PASSED test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select PASSED test_rocksdb_options/test.py::test_table_invalid_column_family_options PASSED test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries PASSED test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[0-16] PASSED test_replicated_user_defined_functions/test.py::test_server_restart PASSED test_scheduler/test.py::test_s3_resource_request_granularity PASSED test_scheduler/test.py::test_throw_on_unknown_workload PASSED test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[8192-12] PASSED test_replicated_merge_tree_s3_zero_copy/test.py::test_s3_check_restore PASSED test_rocksdb_options/test.py::test_table_invalid_options PASSED test_rocksdb_options/test.py::test_table_valid_column_family_options PASSED test_rocksdb_options/test.py::test_table_valid_options PASSED test_rocksdb_options/test.py::test_valid_column_family_options PASSED test_rocksdb_options/test.py::test_valid_options PASSED test_postgresql_replica_database_engine_1/test.py::test_multiple_databases PASSED test_postgresql_replica_database_engine_1/test.py::test_quoting_1 PASSED test_postgresql_replica_database_engine_1/test.py::test_quoting_2 PASSED test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index PASSED test_s3_imds/test_session_token.py::test_credentials_from_metadata PASSED test_replicated_user_defined_functions/test.py::test_start_without_zookeeper PASSED test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3] PASSED test_restore_external_engines/test.py::test_restore_table PASSED test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers PASSED test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver] PASSED test_postgresql_replica_database_engine_1/test.py::test_replicating_dml PASSED test_restore_external_engines/test.py::test_restore_table_null PASSED test_remote_prewhere/test.py::test_remote PASSED test_scheduler/test.py::test_workload_entity_keeper_storage PASSED test_settings_constraints_distributed/test.py::test_insert_clamps_settings PASSED test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished PASSED test_reload_clusters_config/test.py::test_add_cluster PASSED test_s3_latency_log/test.py::test_latency_log PASSED test_settings_constraints_distributed/test.py::test_select_clamps_settings PASSED test_replicated_merge_tree_compatibility/test.py::test_replicated_merge_tree_defaults_compatibility PASSED test_postgresql_replica_database_engine_1/test.py::test_single_transaction PASSED test_s3_imds/test_simple.py::test_credentials_from_metadata PASSED test_postgresql_replica_database_engine_1/test.py::test_table_schema_changes PASSED test_scheduler/test.py::test_workload_hierarchy_changes PASSED test_postgresql_replica_database_engine_1/test.py::test_user_managed_slots PASSED test_s3_storage_class/test.py::test_s3_storage_class_right PASSED test_postgresql_replica_database_engine_1/test.py::test_virtual_columns PASSED test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach PASSED test_remove_stale_moving_parts/test.py::test_remove_stale_moving_parts_without_zookeeper PASSED test_reload_client_certificate/test.py::test_wrong_cn_cert PASSED test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl PASSED test_s3_storage_conf_new_proxy/test.py::test_s3_with_proxy_list[s3] PASSED test_replicated_merge_tree_encrypted_disk/test.py::test_different_keys PASSED test_replicated_merge_tree_encrypted_disk/test.py::test_same_keys PASSED test_reload_clusters_config/test.py::test_delete_cluster PASSED test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart PASSED test_reload_clusters_config/test.py::test_simple_reload SKIPPED [1] test_rename_column/test.py:338: Consume tons of memory with sanitizer SKIPPED [1] test_rename_column/test.py:297: Consume tons of memory with sanitizer SKIPPED [1] test_rename_column/test.py:433: Consume tons of memory with sanitizer SKIPPED [1] test_rename_column/test.py:489: Consume tons of memory with sanitizer SKIPPED [1] test_rename_column/test.py:380: Consume tons of memory with sanitizer SKIPPED [1] test_rename_column/test.py:555: Consume tons of memory with sanitizer SKIPPED [1] test_rename_column/test.py:670: Consume tons of memory with sanitizer SKIPPED [1] test_rename_column/test.py:596: Consume tons of memory with sanitizer ======= 1 failed, 91 passed, 8 skipped, 34 warnings in 504.31s (0:08:24) ======= Traceback (most recent call last): File "/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration/./runner", line 528, in subprocess.check_call(cmd, shell=True, bufsize=0) File "/usr/lib/python3.10/subprocess.py", line 369, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command 'docker run --rm --name clickhouse_integration_tests_oaaanz --privileged --dns-search='.' --memory=30709035008 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=5dc43a6382f0 -e DOCKER_BASE_TAG=8b2301119731 -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=caad4729259e -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e CLICKHOUSE_USE_OLD_ANALYZER=1 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_postgresql_replica_database_engine_1/test.py::test_different_data_types test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries test_postgresql_replica_database_engine_1/test.py::test_multiple_databases test_postgresql_replica_database_engine_1/test.py::test_quoting_1 test_postgresql_replica_database_engine_1/test.py::test_quoting_2 test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index test_postgresql_replica_database_engine_1/test.py::test_replicating_dml test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_single_transaction test_postgresql_replica_database_engine_1/test.py::test_table_schema_changes test_postgresql_replica_database_engine_1/test.py::test_user_managed_slots test_postgresql_replica_database_engine_1/test.py::test_virtual_columns test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers test_reload_client_certificate/test.py::test_correct_cn_cert test_reload_client_certificate/test.py::test_wrong_cn_cert test_reload_clusters_config/test.py::test_add_cluster test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_simple_reload test_reload_clusters_config/test.py::test_update_one_cluster test_remote_prewhere/test.py::test_remote test_remove_stale_moving_parts/test.py::test_remove_stale_moving_parts_without_zookeeper test_rename_column/test.py::test_rename_distributed test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select test_rename_column/test.py::test_rename_parallel test_rename_column/test.py::test_rename_parallel_same_node test_rename_column/test.py::test_rename_with_parallel_insert test_rename_column/test.py::test_rename_with_parallel_merges test_rename_column/test.py::test_rename_with_parallel_select test_rename_column/test.py::test_rename_with_parallel_slow_insert test_rename_column/test.py::test_rename_with_parallel_ttl_delete test_rename_column/test.py::test_rename_with_parallel_ttl_move test_replicated_merge_tree_compatibility/test.py::test_replicated_merge_tree_defaults_compatibility test_replicated_merge_tree_encrypted_disk/test.py::test_different_keys test_replicated_merge_tree_encrypted_disk/test.py::test_same_keys test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl test_replicated_merge_tree_s3_zero_copy/test.py::test_drop_table 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[0-16]' 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[8192-12]' test_replicated_merge_tree_s3_zero_copy/test.py::test_s3_check_restore test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns test_replicated_user_defined_functions/test.py::test_create_and_drop 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[false-expected_raise1]' 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[true-expected_raise0]' test_replicated_user_defined_functions/test.py::test_create_and_replace test_replicated_user_defined_functions/test.py::test_drop_if_exists test_replicated_user_defined_functions/test.py::test_reload_zookeeper test_replicated_user_defined_functions/test.py::test_replication test_replicated_user_defined_functions/test.py::test_replication_replace_by_another_node_after_creation test_replicated_user_defined_functions/test.py::test_server_restart test_replicated_user_defined_functions/test.py::test_start_without_zookeeper test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart test_restore_external_engines/test.py::test_restore_table test_restore_external_engines/test.py::test_restore_table_null test_rocksdb_options/test.py::test_invalid_block_based_table_options test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options test_s3_imds/test_session_token.py::test_credentials_from_metadata test_s3_imds/test_simple.py::test_credentials_from_metadata test_s3_latency_log/test.py::test_latency_log test_s3_low_cardinality_right_border/test.py::test_s3_right_border test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 test_s3_storage_class/test.py::test_s3_storage_class_right 'test_s3_storage_conf_new_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver]' test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy_no_proxy test_scheduler/test.py::test_create_workload test_scheduler/test.py::test_merge_workload test_scheduler/test.py::test_merge_workload_change test_scheduler/test.py::test_merge_workload_override test_scheduler/test.py::test_mutate_workload test_scheduler/test.py::test_mutation_workload_change test_scheduler/test.py::test_mutation_workload_override test_scheduler/test.py::test_resource_any_disk test_scheduler/test.py::test_resource_read_and_write test_scheduler/test.py::test_s3_disk test_scheduler/test.py::test_s3_resource_request_granularity test_scheduler/test.py::test_throw_on_unknown_workload test_scheduler/test.py::test_workload_entity_keeper_storage test_scheduler/test.py::test_workload_hierarchy_changes test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_settings_constraints_distributed/test.py::test_select_clamps_settings -vvv -ss" altinityinfra/integration-tests-runner:2165613c5fcd ' returned non-zero exit status 1.